Some thoughts about research and upgrades in RTS games

(read this post at its original location here if you want)

Research. Upgrades. The topic is something I've been thinking about quite a bit lately. I think some of the interest comes from my renewed attention to Warcraft 3 thanks to Reforged (I haven't refunded it and keep coming back to the game in spite of the flaws). But, most strategy games include an upgrade system of some sort. Regarding WarCraft 3: I personally find the upgrade systems in Blizzard's games (specifically, the WarCraft and StarCraft franchises) a bit lacking and have been trying to articulate precisely why. But... more on that later. We'll work our way back around to talking about that.

Gating mechanisms are pretty integral to RTS design: population cap curbs army growth, resources force the player to make tough choices about how they are going to define their core strategy at any given point in the game. And for many games, a big part of this, too, are research or upgrade systems.

While resources serve to force the player to make economical decisions to pursue a strategy (and prevent them from pursuing too many paths towards victory at once), and population cap gates how fast a player is able to expand their total military might, research serves as a kind of 'god of the gaps' - it's often used to gate access to game-changing abilities and to handle how early-game units scale into the end game.

At its best, research and upgrade allow the player to adapt to the battlefield and increase replayability of a game by presenting different choices and interaction. The permanence of research is something else of interest to me: often, upgrades in strategy games are elements that cannot be removed once gained. You can't lose that +1 armor for your infantry, though its impact is variable because, of course, you can lose your infantry.

At its worst, research and upgrades can provide the player with rote-memory tasks and punish them with invisible numerical disadvantages for forgetting to click the right buttons at the right time.

Let's dig in.

Definitions - What are we working with?

I always like to start by defining my terms. Making sure that everyone involved in discussing a particular topic is on the same page regarding what, specifically, is being discussed is a big priority of mine. So, apologies if this feels a bit reductive or an unnecessary explanation. I just put a lot of stock in being clear.

'Research' and 'upgrades' encompass a wide variety of possible systems in strategy games.

Engineering Bay, from StarCraft 2

In StarCraft and WarCraft games, 'Research' entails functions contained withing some structures which permanently modify one or more types of unit from the point at which the function concludes. This could unlock new abilities, or modify attributes such as attack damage. This has become one of the standard models for upgrades in RTS.

In Command and Conquer games, there's no 'research' as such - simply placing a new building expands the player's tech tree. Kane's Wrath is one major exception here, where some buildings do contain unit upgrades. It is interesting to me that Red Alert 3 stepped back from this.

An example of a 'meta tree' research, as depicted in Supreme Commander 2

Another type of research we see in strategy games is what I'll call a 'meta-tree'. It exists as a separate menu within the game's UI that contains one or more branching paths enabling access to new units, structures, and unit abilities, and enhancements. Sometimes, the nodes on these menus are activated by unlocking a previous node; sometimes, they're activated based on game performance (killing enemy units) or by building certain structures that enable them.

In Dawn of War 2, for example, many squads have multiple upgrades that can be applied: some of these upgrades are mutually exclusive, as with Chaos Space Marine squads

There's another type of 'research' or upgrade that we see: Relic's Dawn of War Company of Heroes games are a good example of this 3rd main category. These are upgrades that are applied to individual units: modifications or abilities granted after a unit interacts with a specific game object. BAR rifles on US forces, for instance.

Whether they exist on their own menu or 'contained' within structures, the effects they have are largely consistent. So this brings, us, finally, to a definition:

Upgrades are permanent or persistent modifiers to game pieces (that is, units or structures) that alter how these game pieces interact with other game pieces in positive ways. Furthermore, upgrades require player interaction, planning, and resources to acquire.

The process of acquiring upgrades, which takes time, is called 'Research'. Below, I want to address both the method of acquiring upgrade modifiers, and to discuss their functions. So, we'll look at how you get upgrades, and what they do.

Squad with Veterancy

Originally, I had written a couple of paragraphs here about how veteran status bonuses from games like Company of Heroes, and hero level stat increases and ability gain are not, technically, upgrades for the purposes of this article. In the (too) many weeks I've been tinkering with this piece, I've come to change my view on that and so I've removed the section.

Going forward, I am going to include any statistic-based bonus to units that is derived by player action and some sort of limiting factor an upgrade. Hero upgrades and unit veterancy might not, strictly speaking, cost resources in the same way that buying a new unit costs resources, but right now I see that as a distinction without a difference. Player action and the limited resource of the player's time and attention and ability to keep the unit alive are important considerations. These upgrades aren't acquired through research, but to me they're still "upgrades" of a sort, though I think I want to address XP and veterancy in its own article.

Upgrade and Research Design - What is the goal?

A research tree from Sins of a Solar Empire

We're going to start by talking about how you get upgrades onto your units. For the purposes of categorization, I'm labeling all of the various methods of making your army better under the heading of 'research' though as we've already addressed, many of the methods of improvement fall into their own unique buckets. A Warcraft hero or Company of Heroes Rifleman Squad leveling up/gaining veteran status isn't really a 'research' action in the same way as clicking on a +1 damage upgrade in a Blacksmith or Armory, but it does involve an expenditure of time, attention, and oftentimes resources in order to keep these units alive and improve them individually.

RTS, as with many genres of game, is defined in part by a constant struggle to include enough depth and breadth to make gameplay consistently replayable and interesting across the longest possible time, contrasted against the need to the game understandable and straightforward enough to not drive players away or annoy them with pointless busywork or poorly implemented systems that they have to fight against in order to succeed.

At their worst, upgrade systems add complexity without doing much about depth. They add busywork button-clicks whose main point of interest is the cost and timing that are associated with them. At their best, upgrade systems add interesting choices to a game, allowing players to specialize and forcing presenting the player with non-trivial options.

All of this, however, begs the question of what the purpose of upgrade systems is in the first place. What's the goal?

In Age of Empires games, it's easy to tell what Age you and your opponent(s) are in from looking at structures, since many change as Age is increased.

I see a couple of objectives for research. First, they're put in place as another focusing and gating mechanism. The player has a lot of options in a strategy game, and must select among them using the limited resources of their income/economy as well as their their time to define how they're going to approach the game. This is especially true in the early minutes of an RTS match, but often remains broadly true regardless of match stage.

A player trying to build everything is never going to be effective: players in RTS typically strive to find the most time- and resource-efficient way to field a winning army composition. How few resources can I use to get to a point where I overpower the enemy?

This is where upgrades can come in. Typically, in the early stages of a competitive match, choosing to research an upgrade can cost as much as a production structure or a handful of units. Take one at the wrong time, and your army will be too small to handle what your opponent will throw at you. But, take an upgrade too late and your army won't have the firepower it needs. As with so much of RTS gameplay, knowing when to click that button (in games where this is the model for applying upgrades to units) is a matter of some finesse and precision.

Buildings provide a spatial and temporal decision tree: when to build, where to build (do I want to hide this structure? Is it vulnerable? Can i protect something by blocking that thing off with my structure? The implications of having whatever is building the structure not doing something else).

Training and positioning of an army are another unique decision tree: where will this unit be most effective? When do I be aggressive? When do I defend? et cetera.

Research is unique in that it often cannot be lost and acts as mostly a force multiplier to something else in the game: this unit type performs better: it harvests more Lumber, or deals more damage, or has a new ability that it didn't have before. The money spent on research makes the other money you spent on units or buildings to be worth more.

Personally, I take what might be an kind of unscientific approach to design in strategy games. I find excitement in having a wide variety of avenues of approach to the game. In fact, my whole definition of game balance in general boils down to: how many viable responses or avenues of approach does a player have at any given time?

If a player has only one real meaningful choice that they can make to improve their position and attempt to win, the game is not balanced, no matter how powerful that 1 approach might be.

I also try to measure the difficulty of performing a particular action versus the difficulty of stopping it, bearing in mind the weight of how game-changing the action would be if successful. Basically: how many choices does the player have, how risky are they, and what is the impact if they pull it off, and how many viable choices does the opponent have in turn?

Basically, I feel like the player's paths to choose how to approach a situation in a strategy game are what drives the interest in a strategy game. And so, that's how I judge the effectiveness of upgrades in strategy games. What options do they open up for the player? What interesting choices do they present?

Strategy-Based Upgrade Design

In WarCraft 3 and StarCraft, having a poorly upgraded army can be a death sentence. But keeping track of unit upgrades is an unintuitive process

In my mind, the weapon and armor upgrades often seen in Blizzard RTS design are 'bottom of the barrel' in terms of how research can shape a game.

Now look. It's not that these systems are bad per se, just that to me they form a less than ideal scenario. Blizzard know what they're doing, of course. They're a celebrated game studio with probably tens or hundreds of millions of players of their games, and I'm just one fat guy behind a computer.

There's a delicate balance to the system they implemented. Their designers craft precise interactions that are modified by these upgrades. One excellent example is how zealots and zerglings interact based on their damage and armor upgrades: a zergling with +1 armor over the Zealots attack upgrades will survive an extra hit from the Zealot. This has a lot of implications on how Zerg can stand up to Protosss in StarCraft 2.

Compare this to an example in Grey Goo. Normally, the Human faction's Lancer unit deals Void Ray like damage to enemies: it deals increasing damage over time to a single target. There's an upgrade in the game called 'Railgun Systems' that swaps out the Lancer's attack: instead of single target anti-armor, the Lancer's attack does damage in a line against swarms of light units.

While Grey Goo is arguably not nearly as good a game as StarCraft 2, I personally feel that the strategic and tactical choice around this upgrade is far more interesting than almost any upgrade in Blizzard's far more popular game.

Not every upgrade in Grey Goo has the same level of interest: another upgrade choice for the Humans turns harvester units invisible, while there's one that allows certain classes of turret to remain powered even when they're supposed to be offline. But, to me, this one example is perfect to describe what I'm looking for. This is a meaningful choice that has a dramatic impact on the game.

The Dawn of War games have similar choices: The Necron Lord, for instance, has to choose a limited number of Wargear items to research at any given time, and many squads have mutually exclusive upgrades that change how they handle combat. Individual Chaos Space Marines squads, for example, can choose to outfit themselves with either the Mark of Khorne, which makes them melee specialists, or the Mark of Tzeentch, which specializes them against heavy foes.

These upgrades provide players with dramatic choices that have dramatic results. They provide clear benefits and downsides that are intelligible and understandable, and have readable impacts for both the player and their opponent. To me, this is much preferred over invisible stat bonuses with entirely mechanical considerations and little impact on how the game is played but instead only provide impact on the outcomes of that play.

Similarly, I wish I could track down a quality image or other recording of how upgrades work in Universe at War: Earth Assault. In UAW (as it's often abbreviated), each faction has 3 separate tech paths, each with 4 upgrades. Each upgrade takes time and increasing amounts of money to unlock. More interestingly, the player can only choose a total of 6 out of the 12 upgrades, and each upgrade unlocks the next one in its sequence. This often force the player to choose all 4 unlocks from one tech path and 2 from another, or 4 - 1 - 1, or 3 - 3, or some other combination depending on their strategy.

The upgrades in UAW unlocked new abilities to units, added Node types for one faction's giant walker robots, and generally were central to defining how a faction approached the game. Whether the player wanted to focus on debuffs, or fast mobile attackers, or heavy hitting, there were multiple upgrade paths that allowed them to focus more in one direction or another. And with both UAW and Grey Goo, players had the flexibility to remove and repurchase their selected upgrades, to change their approach with a bit of lead time.

The best image I can find of the UAW tech tree

In Conclusion

I feel like I've rambled a bit in this article. I've tried to make the point that upgrades are an ephemeral but important part of RTS games, and to discuss their place between the more tangible assets of units and structures.

I've tried to approach my position on the topic openly and honestly: talking about my preferences and my reasoning for them instead of a hypothetical best thing for the genre.

I am a favor of clarity and readability in games. To allow the results of choices to be dramatic and understandable: a different weapon, a change in function, a change that is noticeable and digestible by all affected parties. I feel like upgrades should provide options for players to help refine their strategy, instead of minor, mostly hidden mechanical modifiers that act as simple force multipliers.

Thanks for reading.

(read this post at its original location here if you want)