HD Render Pipeline: can't recommend to upgrade yet (feedback)

During 2018 I avoided upgrading my project to HDRP knowing it was still a beta in development. Seeing that Unity was announcing 2018.3 release as "the one" to use HDRP, last week I decided take the leap thinking it would be pretty polished and it would only take some time to update or redo shaders and lighting, but I found some important issues related to performance:

• The global frame rate of the project dropped by 20% (10% after tweaking some parameters)
• The startup time to play the game increased by 75% (from 9 to 16 seconds)
• But the worst problem is Building the project. It takes about 10 times more (no kidding, I measured it) because of the 'Compiling Shader Variants' part of the process. It's so slow that I kept killing Unity process thinking it was frozen until I read this is a real issue of the new pipeline.

So working with the project right now is a painfully slow experience that I don't know how to afford. Unless I'm missing something or did something wrong (any clue to improve performance will be appreciated), I honestly don't think Unity should encourage people to use the new HDRP, it's not production ready yet.

And don't get me wrong. I really think HDRP is an important and necessary feature for Unity, but right now you can feel it's not there yet.

[-----EDIT-----]
Ok, so after a couple of days playing around with HDRP I think I have a better vision of what I think it's actually good or bad. I'll try to be as objective as I can.

Upgrading the project

• The upgrade process: it was more or less what I expected: some shaders where upgraded automatically and some of them (about 40%) manually. I think it's a quite high percentage, half of the screen remains pink, so this is the first scary moment you have.
• Lighting and shaders: I had to tweak every single shader and light to get the right appearance back. No big deal with this, it's the same when you change for example from Mental Ray to Arnold in a 3D software. The good thing was I could take everything a step further in terms of image quality.
• Choosing the right version: I couldn't find any reference to understand which of the 20+ preview versions of HDRP is the right one to install. Why are there so many of them and why are all exposed to install?

Working with the project

• Frame rate: Probably the first shocking surprise is checking that the project is suddenly slower in terms of frame rate. I guess the HDRP makes more effort to get a better image quality, but you feel lost trying to find out what you can activate or deactivate to increase it. It would be really important to have a complete visual guide to understand which of the dozens of parameters you actually need.
• Render Layers: The old layers don't work with the new lights, and it was a bit painful to find out how to make them work again. I had to write a custom editor to make the Renderers point to the new Render Layers. Again, I felt lost trying to fix this and found almost no documentation (in some cases not even the basic Unity help, it's not written yet).
• Shadows: I've been unable to find the way to enable shadows to more than one light. As soon as I activate shadows to a second light I get the warning "Cascade Shadow atlasing has failed, try reducing the shadow resolution of the directional light or increase the shadow atlas size". I increased every single atlas value I found with no luck. No matter what I type it never lets me have two lights with shadows.
• Environment: It took me a lot of time finding out how to create a sky in the new system. It's very difficult to find any piece of information. Anyway, the new one is waaaay better than the old one.
• Startup time: Here I honestly have no clue at all of what's going on. An 80% increase on startup time when you want to play the game is way too much, and I don't know if it's something you have to expect after upgrading or some kind of issue with this specific project.
• Build time: Ok, this one isn't so dramatic as I thought, here's the thing. Yes, it takes forever to make the first build. Seriously guys, it doesn't make sense. 20 minutes to build a small project with less than 100 shaders with only 5 bitmaps makes you desperate. It's the 'Compiling Shader Variants' what makes it so long. But after this first build, the next ones work again in a normal amount of time. It took me some time to realize about this because I never let the first build finish. I killed the process thinking it was frozen and start the whole thing from scratch again and again. So I think it would be good to have some kind of advice telling you it's normal
• Graphics broken: I've had to re-import my project into a new, clean one to restore the graphics. For some reason I couldn't find out first the graphics started to render like a bunch of random colored pixels, and the next day they wouldn't render at all even creating new HDRP Assets from scratch. I guess this is nothing special knowing it's still a WIP version and I probably touched too many parameters until I understood what they were for.

So, to summarize, I guess that the main problem is feeling lost when you try to go through this upgrade process. To me, Unity's best feature it's not only the platform itself, but the fact that you have infinite documentation resources everywhere (official docs, forums, Youtube, friends...). So having to go through all this process with almost no documentation was an unpleasant experience. I understand the rest of the issues are normal in a WIP version.

Anyway, I think it would be good to have a complete step by step guide to understand the new components and features deeply. Knowing that thousands of users have worked with Unity for years, it would be good to have some videotutorial showing how to make the old stuff the new way. I guess you already have that planned for the final release anyway.

Despite all this, I have to thank the team for the effort of building the new render pipelines. It's perfectly understandable where are they going and the new shaders and lights are accurate and easy to use.

 

Huh? The HDRP is still in "Preview", meaning it's WIP and not yet production-ready (even though it became more stable, according to the 2018.3 Release blog post). You are free to give it a try. However, unless the "Preview" label is removed, expect quirks like those you've mentioned. This has always been communicated like that.

As for your performance issues, have you used the Profiler?

 

I have a long list of suggestions on tackling this, under this thread: https://forum.unity.com/threads/compiling-shader-variants-taking-ages.527724/page-3#post-4095598

 

Also, this belongs to General Graphics sub-forum.

 

As soon as I installed I realized it's still a preview, but I probably got carried away by the strong marketing and demos showing the capabilities of HDRP and assumed it was in a more mature stage. That's why I'm posting this thread, to be sure that people don't make the same mistake I made.

I didn't dig it down yet with the profiler. The thing is the same project that was soft and fluid before is now heavier and buggy. I'll test it more during the next days.

 

Thing is, with HDRP you're putting more feature support into your project.
Even if you do not use specific ones, support in the pipeline still will be there.

Sure, some cost are due to not all parts are being optimized, but the overhead should always be kept in mind.
Note that on PC / Last - Next gen consoles nobody cares about that.

A-AAA games released with HDRP will probably take 2-5 years to complete.
At that point either it will be optimized and ready, or rewritten by the game devs on their own.

Tip: Just read / research what's being dumped into the project before dumping anything.
If not satisfied with the result - rollback. Even a loss is a result / experience.

 

Another thing worth mentioning, in case it's not clear: The default HDRP settings that you get are fairly high-end. If build times are very long for you, I'm guessing you haven't tried toning down the settings at all. (Disabling certain HDRP features results in faster builds due to fewer shader variants being compiled.)

I mainly upgraded to HDRP so that I could use some of the new cool stuff (like Shader Graph), and some of the most high-end visuals aren't essential for me. So I'm turned off a few things I don't really need. This improved framerate and build times. So, if you haven't yet, consider whether you can turn some things off in the HDRP settings to achieve better performance. But remember that the whole thing about HDRP is a higher quality visual experience at the expense of worst performance. Consider whether your project might be as good or better using LWRP instead.

 

Moved thread to experimental+edited slightly. Please be specific about the reasons holding you back from moving to HDRP, feel free to go into deep details.

 

"The target audience for LW RP is developers targeting a broad range of mobile platforms, VR and those that develop games with limited realtime lighting needs". (source)
If HDRP is too consuming, but you still want all that fancy stuff, then just use Unity's built-in pipeline as before.

 

Are you sure your build time didnt just go up because of the general changes to shader variant compilation? If you handle your variants fine it should be only marginally longer on HDRP

 

Thanks! I've edited my first post to give you an updated view of the whole process I've been through these days.

 

Thanks a lot for the answer. A lot of useful information there. Very interesting to have a wide look of the development phases and planning. I'll have a deep look to all of those documents.

>Lighting and shaders:
As explain above, we were not aiming at giving you the same result than in Builtin, so if you get the same result it mean that we have fail our job
​

You can be absolutely relaxed about this. Despite all the problems the graphics quality is something you immediately feel as an important step forward

>Frame rate:
Hard to give more information without a full description of your scene and what you aim for. HDRP have a way bigger entry cost than Builtin (or LW). But it scale very well. Try to put 2 lights, it may be way more costly than Buitlin. Try to add 200 lights and you will see where is the improvement .
​

I guess this is my problem. It's a project with exterior lighting (only 5 lights to cover everything). I'm probably in the "extra cost" area.

>Render Layers:
We don't use render layers for light linking, we have switch to Light Layers.
(doc isn't written yet: https://github.com/Unity-Technologies/ScriptableRenderPipeline/wiki/Light-layers)
Is it what you are looking for ? Light linking?
​

Sorry, I used the wrong word, I meant Light Layers.The thing is, I coundn't find any UI to setup them or do simple operations like selecting the objects pointing to a specific Light Layer, include/exclude operation, etc. So I had to write my own editor script for these basic operations.

>Shadows: I've been unable to find the way to enable shadows to more than one light.
Which version? On 4.8.0 all is fine. The exception is that you can only have one directional light with shadow. So I suppose this is what you have try ?​

I'm on 4.8.0, but all my lights are direct (exterior scene). The restriction of only one direct light with shadows, is it temporary or permanent?

 

Only one directional light with shadows is a permanent design decision. Having more would be too costly so we don't support it.

 

Great to hear that. The Builtin version had at least the basic layer tools where you could quickly select a group of objects and assign them to a layer. You could also of course rename, add, remove layers... That's basically what I'm missing the most, but I think it could be easy to add some more useful functions similar to 3D packages like Max or Maya. I throw some quick ideas for that UI:

• List all the Light Layers
• Basic Light Layer functions (rename, add, remove). I'm not sure if adding/removing Light Layers is possible
• Add/remove selected objects to the light layer.
• List/select all the lights affecting the light layer
• Select all the objects included in a Light Layer. This is extremely useful to know if an object is affected by a wrong Light or if any object is missing
• In the Light Explorer, it would be great to have a Light Layer column to quickly check what lights affect what Light Layers. By the way, the Light Explorer throws constant errors in unity 2018.3.2f1, HDRP 4.8.0. "EndLayoutGroup: BeginLayoutGroup must be called first."

[EDIT]

• I forgot a very important one. Since the introduction of Prefab Mode in this last version of Unity, you can't access the components of the prefabs unless you enter that Prefab Mode. So if I want to change the Light Layer of 100 art prefabs I have to go one by one entering Prefab Mode to access the Mesh Renderer. This took me all the evening yesterday. This is not only an issue for Light Layers, but for any global change you want to make to make to a group of objects sharing the same components.

 

Well, that sounds like a tough decision. If that's the way it's meant to be, then I have a doubt I'm unable to solve. The reason why I have multiple direct lights is because I'm unable to make my gradient sky to light my scene objects, and I'm trying to emulate that with direct lights pointing everywhere with soft shadows enabled. If that's not possible anymore, how do I get my sky to light the scene objects?

 

Box Light can do the directional lighting, don't forget and you can have a lot of those. Sky should light (but not shadow)

 

I can see a tiny minimal reaction of the objects to the sky color, but I can't find any kind of multiplier to control the intensity of the direct lighting.

"Box Light"? I'm afraid I have no idea what is that, and I can't find it.

 

I think it's the Spotlight but changing its shape to Box. If not then it's the Area Light but this requires baking to have shadows.

 

There is HDRI support you just have to set it up. On the Scene Volume Setting, add the HDRI component and change the Visible sky to HDRI as well as the Baking Sky.

I would advise taking some time to just go through the different things in HDRP, that's how I and most people here learned most of what we know. Earlier on there wasn't any documentation, now there is on some of the main things you'll come across. https://github.com/Unity-Technologi...nder-pipelines.high-definition/Documentation~