Featured Blog | This community-written post highlights the best of what the game industry has to offer. Read more like it on the Game Developer Blogs or learn how to Submit Your Own Blog Post
I normally do not share my past struggles, but this topic deserves it. What to do when you lose hope with Unity UI? Dozens of projects with Unity UI in mobile and console platforms taught me what I will share with you in just a few minutes.
[Read the original blog post on Unity UI Optimization at The Gamedev Guru's Blog]
I normally do not share my past struggles, but this topic deserves it. What to do when you lose hope with Unity UI?
I still remember that weekend, about five years ago...
I spent the entire weekend worried about all the technical debt I was accumulating over the months in one of my projects. I had done things too quickly, without really understanding them. Clearly enough, that had to stop working at some point.
The thing is, I owed my clients results but I had no idea how to bring them. That morning though, I said to myself: Rubén, this is enough. Stop the excuses. You are becoming a professional today.
So, I decided to gather every single resource I could find about user interfaces in Unity, because that was the biggest hurdle I was dealing with for several weeks. I read forums, best practices, Unite videos, read all blogs I could find on that topic and did my own research.
Unity UI Development Triangle
Did you ever experience this feeling of slowly getting overwhelmed by technical debt? It accumulates over time and someday you either give up or decide to crush it. In my case, it was the later.
You probably heard that optimizing UI in Unity is challenging. Or, if lucky, you know it from first-hand experience. Yes, Unity UI is a powerful tool and I love it. However, its mightiness can quickly transform into a deadly weapon if it falls into inexperienced hands. And so were my hands back then.
If I had to confess anything to you today, it would be this: I wished I had had a solid foundation on Unity UI before I designed the UI of several games.
It is SO easy to do it wrong, SO easy to get frustrated. In my opinion, there's something even easier than that. That is, for your client to ask you to do over-hours to get your shit together.
In my experience in the professional sector, companies do not want developers who design poorly optimizable interfaces and leave the tuning task to experienced programmers. They rather want developers who create visually stunning interfaces, but also performant.
And even in the indie development scene, where would you choose to spend your time on? Bringing fun to your players, or spending hours clicking through the profiler to find bottlenecks?
In my opinion: no matter your role, you should understand basic Unity UI design principles. But this takes time and project experience. You might not have any of these.
Hopefully, I can help you there.
Today, I will give you one of my most powerful tools: The Guru's UI Development Diagram
As usual, I'd like to start with the Level 1 Developer construct
unity-ui-update-batches-layout-spikes
Level 1 Unity UI Developer: UpdateBatches & Layout Spikes in Unity UIThis is where we all start: free-style design, free-style results.
I used to import sprites with whatever settings. Then, I would add them as images everywhere with no predefined criteria. And so I ended up with an unstructured hierarchy full of components that I didn't need. I used the wrong systems for the wrong reasons.
Overlapping UI elements, a motherload of batches, profiler spikes. Those are all common.
Do I have anything against this?
Partially. I think it is great to play around and to make mistakes. Breaking and repairing help learning.
But if you want to do this for a living, at some point you might want to level up your skills and embrace professionalism.
This becomes unacceptable in the games industry, especially in Virtual Reality. If you do this in VR you will turn players into patients.
Such a chaotic Canvas hierarchy structure could look like this:
unity-ui-unstructured-hierarchy
Level 1 Unity UI Developer: Unstructured Unity UI Hierarchy
You do a lot of nesting, you use auto-layout components everywhere and there is a lack of rules.
At some point, someone will ask you to optimize your UI. That could be your players, your boss or even your own pride.
But you might not be ready for this. You might be caught off-guard having other tasks on your plate. And UI development is daunting at the beginning.
The reason for its complexity lies in the amount of factors it involves. Leaving the visual appeal aside, you can say that the way you work with Unity UI will have a big impact in three critical hardware pieces: the CPU, the GPU and the developer theirself.
If you are lost, it's good, because...
I am about to show you something cool
Let's level up as a developer!
the-gamedev-guru-Unity-UI-development-diagram
Here we are with a Venn Diagram. I decided to call it The Guru's UI Development Diagram.
There we see three big chunks related to Unity UI Optimization: CPU, GPU, and Developer. Those are the main resources you will have to spare when developing UI.
I want to give you a short overview before we start digging in the topics.
You pay the CPU toll mainly when generating and submitting batches of UI. You can think of them as UI components, such as images. The more of those you have, the more strain you will put in your processor.
The turn for the GPU. You pay the GPU resources mostly in concept of overdraw. This means, stacking layers of graphics on top of each other.​
Lastly, the developer pain is paid in time. You spend time every time you design or maintain your UI. Unity offers you some tools to make it easier for you, e.g. auto-layout helpers.
The cost of the three components rely mostly on you, but they sometimes counteract each other. It's very challenging to perform in every aspect, unless you are very experienced and you have the right tools.
Eventually, you will get there.
I would like you to have a closer look at the attached Guru's UI Development Diagram.
You might be confused. That's alright, because we are going to cover each section separately. You will get to understand all of it.
For now, you only have to understand one thing: in the end, it will be up to you to find the balance between the three variables in your game.
Before we start with each component, have a look at these general rules:
The easier you want the UI design workflow to be, the less performant your UI will be.
If you want more GPU performance, you will have to focus on finely tweaking graphical elements and avoid element stacking.
For more CPU performance, you will need to reduce the amount of graphical elements present in the hierarchy.
Let's move on, I can't wait to show you the CPU side of Unity UI Optimization!
Level 2 Unity UI Developer: The CPU
In my opinion, this is very simple.
The golden rule is:
Every time you add a UI component in your scene, you are adding CPU overhead
Each component increases the CPU cost for the following reasons:
RectTransform calculation: this is pretty much free in simple canvas hierarchies. However, your CPU will have a harder time if you are using auto-layout components to ease your UI design workflow, such as vertical layout groups and such. The issue with those is that most RectTransforms present in the hierarchy will now depend on each other, so the calculation becomes more complex.
Vertex generation: the GPU understands vertices, thus those must be provided by the CPU. Vertices must be generated based on the entire canvas hierarchy of the involved RectTransform elements. The vertices depend as well on the specific type of UI element you added (images, texts). Under this category, we also include the cost for the CPU to add other per-vertex attributes such as colors and UVs.
Dynamic batching: because draw calls are expensive, Unity does its best to dynamically batch as many of them as possible.
Think of this as combining a large number of small groups of vertices into a single, huge group of vertices. Because... would you rather go to the supermarket ten times to bring an apple each, or go just once and grab them all together?
Batching is, however, an expensive operation for the CPU which increases with the amount of UI elements you have.
Draw call emission: finally, the generated batches must be sent to the GPU. These graphical processing units are very picky with the data formats they accept, so the CPU has to make extra work to pack them in a way that they like.
This is expensive, yes. But luckily for us, Unity is kind of smart and caches the canvas so these expensive processes do not happen in every frame.
Just as I brought you good news, I will give you the bad ones: this cache is super easy to break.
Changing almost any attribute of any UI element will break the cache of your canvas. If that happens, we go through most of the process again. These changes, by the way, trigger what is called a canvas rebuild.
I'll give you some examples of the breaking changes: scaling, positioning, rotation, color, image swapping, animations and more.
After exposing the basics, I want to conclude with three practical observations:
The more elements you have in your Unity Canvas, the more CPU overhead you will have on each canvas rebuild.
Avoid any kind of changes in UI to avoid canvas rebuilds. If needed, then put dynamic elements in different canvases.
Canvases are either static or dynamic. Design accordingly.
Unity-UI-optimization-diagram-gpu-only
Now is the turn for the friendly Graphical Processing Unit, don't you think?
The GPU is the piece of hardware that makes us fall in love with games. We owe them so much. What about showing it some affection? Well, we can...
By treating it well.
But guess what? UI can make the GPU pretty upset. Especially mobile GPUs, where it is relatively easy to be memory-bound. To put it simply:
In mobile, there is a massive reason UI is expensive: overdraw!
Overdraw happens when we render the same pixel multiple times per frame. And this is soooo easy to achieve with Unity.
Every time to add a Unity UI Image, you are commanding your GPU to draw a full rectangle, rendering every single pixel inside that rectangle. And it does not matter if the pixel you are drawing is transparent, it will cost you still.
That means, I advise you to be careful with the transparent regions of your sprites!
This has some implications for you. If you add 10 full-screen images, then you get 10x overdraw. As my grandmother used to say, WTAIWYG! (What You Add Is What You Get).
Stacking of layers on top of each other will slowly enrage your GPU. It will add milliseconds to it, which is a crime in VR games where your budget could very well be under 13ms.
I do not want to get too technical in this post... but I can't just help it! Some day you will be having a delicious coffee break conversation with your colleagues and you might feel tempted to drop a few intellectual lines. If that's the case, say this one aloud:
UI Overdraw is expensive in mobile because you devour the precious memory bandwidth of the device and this is further worsened by the alpha blending happening internally
You'll make some jaws drop.
The key lesson is easy: avoid stacking UI elements on top of each other and you will be fine
GPU cost mainly comes from stacking graphical layers on top of each other. Avoid these.
Reduce the space UI takes in screen to reduce GPU cost.
Implement sprite atlasing to improve CPU and GPU performance.
PRO TIP #1: Sprite Atlasing
PRO TIP #2: Opaque UI Shading (Advanced)
Level 2 Unity UI Developer: The Developer
I am afraid we often under-estimate the effort required to design, implement and especially maintain optimized user interfaces in Unity.
Surely, Unity improved in this area during the last few years and now it is easier and faster than ever to create those. But this comes at a cost.
In general, the more Unity UI extras you use, the worse your game will perform.
The auto-layout helpers are especially expensive. Unfortunately, they are the most helpful. For instance, I find Vertical Layout Groups especially handy when designing responsive UI. These neat scripts help you organize your elements in a manner that is structured and therefore visually appealing.
The problem I see with those is that they incur on a big CPU cost whenever there are canvas rebuilds!
You might be able to get away with UI helpers if your UI is static 99% of the time, but the frame it isn't, you will notice it.
We love working with helpers, but we don't want to ruin our performance. Here's one trick you can try: keep the auto-layout helpers around while designing but disable them all just before saving your scene. By doing this, they will be deactivated for run-time players, but they already did their work for you!
I don't want to disappoint you, so just remember that this auto-layout disabling secret will not work if your UI content is dynamic.
At the end of the day, the more tasks you delegate to Unity, the more work your hardware will have to do. Find your own balance here! You can start using those helpers but be ready to remove them if you have to.
While optimizing, do the biggest gains for the buck first. Only advance in the ladder of diminishing returns if the profiler tells you that you have to.
For instance, creating sprite atlases is easy and will bring you good fortune. Tweaking graphics to avoid transparent regions, however, is more time-consuming. Lastly, creating your own UI shaders might bring you big gains but at a big cost.
Remember, saving a few microseconds in your game might not be worth if it costs you weeks of your life-time and your application does not need it. This should not be taken as an excuse to never care; optimizations in the future are more expensive than in the present.
Profile before you optimize
Keep profiling
Go for the biggest gains for the buck first
Unity-UI-optimization-diagram-intersection
Level 3 Unity UI Developer: The Guru's UI Development Diagram
From the Venn Diagram, you might see several sweet spots where you could find yourself in: Fine-Grained UI Development, Coarse-Grained UI Development, Massive PP and Balance.
They sounded quite obscure to me at the beginning, but then, with time, it all started to make sense to me. Experience brought understanding.
What I still hold true is that, the more tools you know, the better. This is the main way I am able to recognize the subtle patterns in all problems. And, when you recognize the heart of the challenge, you know which tool to take out of your toolbox.
Nothing will help your team more than having a developer possessing both a high-level overview of UI and an eye for detail.
A Level 3 developer would confidently answer important practical questions that only come through experience. I can think of a few that any client could ask you:
Here's a UI architecture for you. How performant is it?
What are 3 alternatives I have to optimize this user interface?
Can you show me numerical proof?
You see, I prepared a few Unity examples for you.
The examples you will have access to illustrate each of the UI optimization methods I propose.
Not only that, I analyzed them all so you can feel safe the information is accurate.
Because... do you know what comes after speaking out of our gut feelings? Speaking with certainty, based on real experience.
So, are you serious about becoming a Level 3 Unity UI Developer?
Read more about:
Featured BlogsYou May Also Like
.png?width=300&auto=webp&quality=80&disable=upscale)
