The Discomfort Zone: The Hidden Potential of Valve’s AI Director

This article originally appeared on dashjump.com.

Left 4 Dead

More...

An obvious answer to the first question is the sense of authentic cooperation created by the game’s mechanics, afforded in no small part by the “Director,” the much-admired AI system that generates random enemy encounters; prompts changes in the environment; and adjusts the placement of items players find, all based on a calculated ‘stress level’ for each player. For the first time in a game, an AI entity could modify multiple elements of the level on the fly for a tailored experience every time. It’s perfect for zombie games, right?

Wrong. It’s perfect for EVERYTHING.

There’s a reason Gabe calls what the AI Director does procedural narrative, and not procedural zombie spawning. All throughout the piece he wrote for Edge as part of a PR push for L4D, he hints broadly about the implications for cooperative games of all types, as well as single-player games. The promise had already been recognized internally at Valve long before the game debuted; the rest of the industry just never caught on.

But back to L4D’s use of it in particular. One thing to note is that the AI Director approach is not dynamic difficulty. Dynamic difficulty has been around for a while, and is largely based around the idea of the system making minute adjustments to existing values in order to raise or lower the game’s difficulty. For example, In Max Payne, the system would make tweaks to enemy health and the degree of aim assistance based on how well/poorly you were dominating/getting wrecked. The end result was a tighter game that never felt too easy or too hard; but all the same, each playthrough was identical.

Apparently, a similar tact was used in Half-Life 2: Episode 1 and 2, where you would receive different items from crates depending on your health status at the time you smashed it. Again, more than anything else, this kind of adjustment on the fly would help level the playing field without altering the experience too much – the core experience is still the same. This is why the AI Director is different – using player activity data, it sculpts a dramatically different experience that fits perfectly with what players are capable of and that engages them on a primal level, since L4D’s focus is a survival/action/horror hybrid.

Max Payne

But if you remove the zombies, health packs and clichéd apocalyptic scenarios, you’d be left with a core truth of what this system affords: instant eviction from the comfort zone. While the comfort zone is a nice place to hang out in, in life as well as in games, the returns diminish quickly since you’re essentially in a suspended state in which no learning takes place.

This is why games that, on paper, should be exciting and thrilling prove to be boring despite the number of explosions, particle effects and screaming marines that fill the screen. Disruption of the expected, when you’re pushed into a new experience and enter the discomfort zone, is the thing ultimately responsible for you learning more about the system, your recourses and your capabilities, and is what makes you better at playing the game. While it’s stressful at first, this dynamic proves to be more pleasurable in the long run.

So why aren’t more games using this principle? After all, it has been almost five years since Valve debuted the Director. The only reasons I can think of are the prohibitive complexity of creating such a system, and simple laziness. Perhaps this system really is only suited for horror games, you say? How could similar systems even be implemented in other games? Let’s take a look!

Racing. Create courses with dynamic events, similar to Split/Second – though instead of having events be scripted into the tracks, enable them on the fly to correspond with the player’s performance.

Shooter. Think of a wide-open shooter with a single-player component, like Halo or Battlefield. Instead of scripted enemy waves attacking from the same direction every time, why not have them drop in via parachute or dropship, launch assaults in vehicles from over the horizon, or spawn mini-bosses where you’d normally expect a battalion?

Split/Second

RPG. In a story-driven RPG that focuses on dialog, should you grow closer to certain NPCs, why not have them drop plot bombshells that threaten your relationship thus far – and better yet, do it in the middle of a climactic battle?

Sandbox. In a Deus Ex-style sandbox game, why not have Director-triggered EMP events temporarily cut off access to certain augmentations, forcing you to adapt to different combinations of powers you wouldn’t normally combine? Remember, the Director would know which combinations you’ve been using regularly.

Arcade. In a Super Hexagon-style reflex/puzzle game, why not sculpt purposeful obstacles for the player that build upon what they’ve just overcome, instead of simply swapping in components from a pool of prefab barriers?

Beat ‘em up. In a God of War-style melee brawler, why not have enemies switch up their attack patterns and weaknesses depending on the player’s proficiency at dispatching certain enemy types?

Of course, there’s a fine line between pushing the player into the discomfort zone and unfairly screwing with the player as a way to extend replay value. In any of the above examples, the key to creating an authentic ‘discomfort zone’ dynamic is to make sure there are plenty of options available to the player under the new circumstances.

If the goal is to encourage improvisation through immediate, unexpected constraints, this would fail if the player did not have adequate options for dealing with the new problem that’s suddenly been foisted upon them.

The secret sauce of L4D, the reason why it was (and continues to be) such a hit, lies in attaining a balance in such a system. It lies in how it makes players anxious for what’s next by making their moment-to-moment actions matter in a more truthful way than purely scripted sequences could.

For developers and designers alike, I challenge you to think of how similar Directors can keep your experiences varied, your players fully engaged and your replay value unlimited.