How AI will completely change video games

Whether you know it or not, you use artificial intelligence all the time. Maybe you own a smart speaker or you’ve seen a self-driving car or you’ve used Google Photos to search for images of your cat. Now, there’s also a good chance you’ve played a video game that happens to have some AI in it, like God of War or Red Dead Redemption 2. What may surprise you is that those two types of AI are not the same thing. The AI in digital systems
and autonomous vehicles is self-learning and really fast, but it’s also really unpredictable. Yet these two worlds are fast colliding, and once game developers
have the right tools and the freedom to make
games that really push the limits of AI, the results are going to be the stuff of science fiction. (electronic music) Over the years, AI has become really good at playing certain games. Try beating your computer at chess on the hardest difficulty.
It’s pretty much impossible. Or even if you’re a pro StarCraft player, DeepMind software can now crush you. I’m here, in the shadows. But the AI inside of a video game, that’s basically been building off the same core set of
principles for decades. Take, for instance, a
classic game like Pac-Man. At different points, the ghosts evaluate where you are in the map and
where you might be going, and then they either chase
you, or they run away from you. It’s not exactly groundbreaking AI, but it is video game AI nonetheless. And what’s remarkable is that the AI you encounter in games today hasn’t really changed that much over the years. Two of the core components
of commercial game AI are pathfinding and finite state machines. Julian Togelius is a
professor of computer science at NYU who spent years
studying the intersection of gaming and artificial intelligence. He walked us through the basic toolkit that underpins a ton of video game AI. Pathfinding is how to get from point A to point B in a simple way, and it’s used in all games all the time. Finite state machine is
a construct where an NPC can be in different states
and move between them. Real AI in commercial games
is more complex than that, but those are some of
the founding principles. So using these basics, developers have created ever-more realistic
game worlds and characters, but that software is
not exactly intelligent. That’s because game developers have yet to really utilize key
advancements in the field of artificial intelligence
research, namely deep learning. Through the deep learning revolution, researchers at universities
and tech companies have made astounding
progress at giving a machine the means to improve itself over time. But there’s a reason game developers aren’t using that type
of AI to develop games. Typically, when you design a game, you want to know what the
player will experience. And for that, if you go
in to evolve any AI there, you want the AI to be predictable. Now, if you just went and
tossed in a neural network that was constantly adapting and learning from all the feedback it got from you, there’s a very good chance something unexpected might happen,
and it could break the game. And that’s a problem for a designer. Imagine if every single character in Red Dead Redemption
remembered all of your crimes, and you couldn’t even play anymore because everyone just
took you down on sight. I’ll put your brains all over you. The way designers think today when they’re designing games,
they want predictability. And therefore, they want the relatively anemic AI we have in games today. What’s more useful for game makers is taking those traditional approaches, and trying them at unprecedented scales. If you play Red Dead Redemption 2, you’ve probably seen this clip. A player firing a warning shot, which shoots a bird right out of the sky. What makes it so interesting is that it isn’t a planned part of the
game. It’s completely random. What? The individual systems
here, the way that bullets move through the sky, and where birds are programmed to fly around, those are not wildly different than the pathfinding Pac-Man ghosts. The difference in a game
like Red Dead Redemption is that all of its many, many systems can overlap and run into one another. The individual pieces aren’t intelligent, but when they come
together, they trick you into thinking they are. Haven’t you brought
enough misery upon us? Another game that’s great at this is The Legend of Zelda: Breath of the Wild. It’s a cohesive world where a
few simple programming rules around weather, gravity, and even heat create endlessly surprising moments. You can use a makeshift
torch to bake an apple while it’s still on a
tree, or drop a bunch of these weird balloon things on a boat, and it’ll soar into the sky. Now, is this really AI? Well, that kind of depends on who you ask. Some argue it’s just automation
or emergent gameplay because these systems
aren’t intelligent, per se. While others say game AI is less about trying to pass off a machine as a human, and more about creating a
sense of wonder and mystery that makes the game feel real. So what would honest to goodness AI-powered video games actually look like? Well, in the Spike Jonze movie Her, creator David O’Reilly
conceived of a video game in which a foul-mouthed character could react dynamically to
you and your personality. It could even taunt and bully
you into continuing to play. Come on, follow me. (beep) Games like this may seem far
off, but we’re getting there. That’s because cutting-edge AI research is finally bleeding over
into game development. Today, researchers are
using the kind of AI that can actually learn
to design entire games, using a technique known
as procedural generation. It was popularized most recently by the indie game No Man’s Sky, but now, AI researchers are using the same technique to create software that can design a game
entirely from scratch. So you can say that not
only do I want to generate a landscape, but I want
to generate a landscape where I know there will be choke points, where we can hide my troops behind, or I know there will be
places to have a castle on, and with no deep valleys
you can fall into. Building off that, game developers could create games that
don’t just generate levels all on their own, but also
learn what you like as a player. In the longer-term
future, we’re going to see game directors that
learn to adapt the game as you are playing it, and
learn to become game masters that play the player as
the player plays the game. There are even ways that AI right now can be used to create the art for games. Take a look at Nvidia’s research generating game graphics
using deep learning. What you’re seeing is not real, an AI used a game engine
and some video footage to teach itself how to generate
an imaginary city block. One that you could see in a game. The same technique can even create all new, never-before-seen faces, ones that look indistinguishable
from real human beings. Of course, that doesn’t stop with faces. You could do mountains,
dogs, space ships, whatever. But the Holy Grail of AI in games would be a true self-learning character that is complex and relatable, and it has a realistic persona
that could build you up. Do you know how to get out of here? Or tear you down. (bleeping) We’re probably not going
to have game characters that sophisticated for a long time. In the short term, big game companies will likely use AI for testing games and boring stuff like analytics. But AI is really tricky, and it requires a ton of tinkering and
training. That’s time and money that game developers don’t always have. So Julian doesn’t see the usual suspects jumping on actual AI
powered games anytime soon. We need to take the AI capability, and think about how can we
design a game around that? And I don’t think that’s going to happen from the big AI companies. It’s too risky. Instead, it might take smaller,
scrappier gaming companies to lean into AI’s quirks
and make something unexpected and strange
that feels entirely new. So if something unexpected
or weird happened to you while you were playing
Red Dead Redemption 2, or even the new Zelda, describe
it in the comments below. And if you have one, leave us a link, too. Thanks for watching.

Leave a Reply

Your email address will not be published. Required fields are marked *