Microsoft’s New AI Reaches High Score in Ms. Pac-Man

There appears to be a rather strange correlation between artificial intelligence and gaming right now. We have seen AIs take on players in Go, and Microsoft is now tackling the infamous Ms. Pac-Man game. Their new AI has claimed the top score in this particular game, which makes it four times better than the top-ranking human player. All of this shows us humans are not necessarily the greatest at video games, unfortunately.

Ms. Pac-Man High Score Smashed By An AI

It is not entirely surprising to learn artificial intelligence solutions are better at playing particular video games compared to most humans. After all, we humans are great at doing several things quite well, whereas an AI can excel at doing just one thing better than anything else. In this particular case, Microsoft’s new AI has thrashed all human players when it comes to Ms. Pac-Man, as it successfully reached the top score possible. An impressive feat, although some people may not be too happy about it.

To put this news into perspective, reaching the top score in Ms. Pac-Man is no easy feat, not even for an AI. In fact, experts felt his particular game is the hardest to beat for an artificial intelligence. There is a lot going on at the same time, and the circumstances of the game can shift around quite a bit. Interestingly enough, Microsoft’s concoction was more than capable of handling the pressure and made playing the game look like a walk in the park.

The AI in question is developed by Maluuba, a Canadian deep learning startup owned by Microsoft. The company was acquired earlier in 2017, and it appears Microsoft has made a smart move in doing so. Beating the Ms. Pac-Man game is the company’s first major feat, but it certainly is one that will go down in the history books. In comparison, the best human player to date scored four times fewer points in the game.

Under the hood, the AI used a method described as Hybrid Reward Architecture. It is a combination of reinforcement learning algorithms. By training around 150 individual AI agents to work together in parallel, the team successfully ensured its creation could reach the top score. All agents were rewarded for eating pellets, whereas others were trained to avoid ghosts. Combining all of these experiences into one project lead to this unexpected success.

The world of video games is slowly being dominated by artificial intelligence these days. Google’s AlphaGo thrashed the world champion not too long ago and promptly announced retirement. Now that Microsoft’s project has beaten Ms. Pac-Man, it is doubtful the AI will play this game ever again. Once the maximum result is achieved, there is no reason for these AI creations to keep playing the same game, as there is no further room for significant improvement.

The fact an AI can defeat a rather unpredictable game with such ease is rather telling, though. It is evident artificial intelligence is incredibly powerful at this stage, at least where these single-player games are concerned. It will take some time until we see an AI be successful in competitive multiplayer games, though, but it may happen at some point.

If you liked this article, follow us on Twitter @themerklenews and make sure to subscribe to our newsletter to receive the latest bitcoin, cryptocurrency, and technology news.