Feedback Hardware Benchmarks 5800x 8400 10900f

Iteration time in this release is much slower than anything previously released. So productivity will sink drastically in some common tasks. Is there a hardware upgrade that can regain velocity to something workable?

Benchmarks show that 2021.1 is on average 60% slower at common tasks such as press play and refresh script and the fastest gain is 80%+ overclocking a 5800x and that's only for script refresh.
Press play will always be slower unless you pour LN2 down a 5800x and sink in 200W. Turning an office into a chemistry lab is not the most practical upgrade path.

You can see more here https://elefantopiainc.blogspot.com/2021/03/impact-of-cpumobomemoryssd-on-speed-of.html

Here is an excerpt;

 

Yeah working in unity 2021 has been a huge pain for me, changing a script in unity now feels like forever, even when we just have 2 or 3 scripts it takes 10-15 secs to compile

 

I gave this a quick try myself with some editor versions I have currently installed, and I'm really disappointed by the latest beta.

Enter playmode:
2018.4.32f1 was the fastest version, entering playmode within 1.5 seconds.
2020.2.3f1 was a bit slower already, entering after 2 seconds.
2021.1.0b11 was slowest, entering after 2.5 seconds (and a bit extra, considering this annoying window appearing for a full second after hitting play every time since 2021.1)

Script or shared DLL changes:
2018.4.32f1 - script changes 2 seconds, DLL import 7 seconds
2020.2.3f1 - script changes 3 seconds, DLL import 8 seconds
2021.1.0b11 - script changes 5 seconds, DLL import 9 seconds

(DLL import means replacing a simple shared library with a few common code lines with a slightly different version that just changes a single string to something else)

I guess it's obvious that the 2021.1 beta has a serious problem. Taking almost double the time to do basic things compared to 2020.2 is completely against any "rapid prototyping" workflow the marketing guys are praising.

I tested this with a Threadripper 3960X on an empty project. If changing Debug.Log("hi") to Debug.Log("bye") takes 5 seconds to recompile already, how on earth are you supposed to prototype any bigger project with a few hundred scripts without getting crazy?

Just to put this into perspective: fully rebuilding a .NET 4.5.2 solution (8 projects, around 110k lines of code) takes about 3 seconds on my machine. But changing a single script line in an otherwise empty Unity 2021.1 project isn't possible in under 5 seconds?

This is ridiculous and almost sounds like a bad joke, and I probably still wouldn't believe it if I didn't just tested it out myself.

 

Would it be possible for 2021.1 to use 2018.4 template for compiling scripts and entering play mode ?

 

Thanks for post, looks like skipping this release completely. The editor is already incredibly slow on the old hardware (2017 year laptop) on 2020.2. It is unimaginable, how it could be much slower.

 

That's odd, because one of Unity's focus in 2021 is editor performance actually:
https://blogs.unity3d.com/2021/01/27/unity-2021-1-beta-is-available-for-feedback/#editor

Perhaps just a bug?

 

You're getting much better deltas than I do with 2020.3 or maybe 2020.1 is faster than 2018.LTS. If you get the courage to test other versions I'm interested. I quite like URP so maybe I'll downgrade to 2019.LTS.

Probably because this blog doesn't actual talk about the use case benchmarked. Cange script->editor interactive & press play -> playing speed are not mentioned.

1323490 for play->playing and 1323492 for scrip change -> editor interactive

Domain reloading regression has been reported by many people since the slowdown of 2020.2 so it's unlikely to be project specific and definitely not hardware specific, as you can also deduct from benchmarking on vastly different hardware. I read that earlier versions of the input system caused massive reload slowdowns so this could be a combination of Unity packages.
You have your own benchmarks. What are the results?

 

I like seeing this

but this only covers one issue.
1323490 can be reproduced with the project I sent Barbora.

 

Please vote on this issue https://issuetracker.unity3d.com/issues/increased-script-compilation-time

 

Thank you for keeping us updated, much appreciated!

 

Thank you Simon for heads up.

Regarding IDE integration, maybe there is a clue here: open Rider in 2017 is near instant, in 20.+ it takes over 15 seconds, 21.1 is a bit slower than 20.1.

Deterministic was turned on in 2020.1.17 as well.
In any case since you asked I'll redo the tests with that off on both versions.
Here are the results:
2020.1.17: 7s
2021.1.1 between 12s and ...

on first compile
deterministic on gives the same results in 21 and slightly slower in 20.1

As much as I like to help you I have to cut down on the testing because it's already cost a lot of time and the project is late. So if you don't mind, instead I'll refer you to Barbora from support, he can give you a copy of the project.

 

I appreciate the team taking a look at this issue. Any improvement is really welcomed.

I just wanted to add my experience:

I have a domain reload tracker in my project since the beginning, starting on Unity 2019.
In 2019.4, my compile/domain reloads were about 6s, sometimes 10s max if I change a lot of editor scripts.

Nowadays in 2020.3, my compile/domain reloads are consistently 11s+. Sometimes even 30s.

I haven't significantly added new scripts or plugins since upgrading to 2020 LTS, but it really feels like my workflow speed has halved.

I appreciate the team that's looking at improving this, as it's one of the non-flashy features that really affect everyone using the engine.

 

Hi Simon,

I just wanted to post here what I posted in the other thread related to those URP framedrops (https://forum.unity.com/threads/scr...-to-compile-reload-than-in-2020-1-17.1065854/).

The massive FPS drop in URP does occur still with 2021.1.0f1 (solving this for 2020.3 LTS is really what matters here but just to say that it doesn't seem to actually have been solved for 2021 unlilke what is stated in the below issue report:
https://issuetracker.unity3d.com/issues/increased-script-compilation-time



Thanks a lot for your help and efforts on this. LeonhardP seems to be looking into the same issue (in case you haven't coordinated yet).

 

Hi Simon,

Thanks for your quick reply.

Here's a whole summary of what I understand of these URP performance issues since 2020.2:
1) Editor Play Mode 50%+ slower compared to 2020.1.17f1:
Issue 1277222 (https://issuetracker.unity3d.com/is...rformance-drop-in-the-editor-during-play-mode)

2) Further In-Editor slowness compared to 2020.1.17f1:
Logged as 1326946 by laurentlavigne (https://forum.unity.com/threads/2020-2-0b1-performance-reduction.965363/page-2#post-7008731)

3) Script compile time significantly longer
Issue 1317926 (https://issuetracker.unity3d.com/issues/increased-script-compilation-time)


I will properly test tonight with my game (lots of units on the map, very stable on 2020.1.17f1 with URP 8.3.1):

 

I also noticed huge slow down since upgrading to 2020.3.1f or sooner since I didnt do any animation work till recently, The stutter for mostly happens when either Animator or Animation windows r open, restarting Unity stops the problem after closing those windows, but itll come back after a min or so using Animator or Animation windows.

I've been working super slowing with blendtrees.. It'd honestly be faster for me to script IK all the finger bones than animate them.

Using a VR project, Windows 10, 10th-Gen I5 3.4Ghz,1660GTX 8DDR5, 32GigDDR4Ram, GodModeNeuclearM2 -1TB+

Recently deleted everything Unity in my AppData hoping to clear old buggy cache form back n the day.
Natta.

I'm considering building a whole new (2000+) Rig just so I can animate some goddam FINGIES.(Also cause I like new Toys)

Would AMD or Intel be better to reduce frameRate/stutter IN EDITOR/NOTPLAYING (EG, holding right click in scene willl randomly frame skip for xxxxx ms delay every x seconds increasing longer editor is up), Yes doing any Animating in playmode will stutter the F outa me too. Infact if I even look at a Clip Unity decides to bully me.

I found similar threads but they are never exactly the same thing, is super old, or just never given a second thought.

Gunna try downgrading to 2019LTS, hope S*** doesn't break OpenXR or anything else.

Seriously Unity wtf, Im embarrassed to talk about Unity to my Unreal colleagues, How can I spread mad Unity love if Unity wont love me back

Here's hoping Iteration saves us all.

 

This is not quite fair - Unity has been moving very fast lately so I think a small number of bugs is normal and the team is quite quick at correcting those: in fact 1) and 3) in my list already got fixed it seems.

I'll download 2020.3.4f1 when it's out and try again with my project. Thanks to the Unity team!

 

I've just downloaded latest release 2020.3.4f1 which fixes the increased script compilation time. It's markedly improved!

Although the Assembly Domain Reload stage is still taking longer than 2019, the reduced compilation time has reduced compile stage for me from about 3s -> .68s.

Now, compile+domain reload times are back down to about 9s for me. Definitely improved!

This could also be placebo, but I am noticing my compile time tracker saying that fewer assemblies are being compiled. Usually, even if I only change a space in a script, it will compile both Assembly-Csharp and Assembly Editor Csharp. Now, it looks like it is correctly only compiling the changed assemblies.

I absolutely cannot wait for the domain reload regression to be improved. I can't wait to get back to the 6s iteration time. It would be a huge boon for my easily distracted brain.

Even this 2s improvement in just compile time is incredible. Thanks again to the team for taking a look at this!

 

Any ETA on fixing the assembly reload times? Waiting for this last bug fix before migrating from 2019.4. It has already 50 votes on the bug tracker. Important for many people and for good reason - iteration time is essential for productivity.

 

Just wanted to add my feedback. Script compile in 2020.3.7f is quite manageable (<5 sec for a medium-size project). But in 2021.1.6.f1 an almost empty project takes about 10 sec to compile.

 

yeah devs fixed compile in 2020.3.4

 

but not doomain ("oo" - dammit G14 keyboard!) reload... yet

 

Been checking every release for the domain reload to be improved. I've also been developing parts of my project in an empty project before bringing it over, to speed up iteration times.

My main project is still at 10sec until editor responsive (core i9), but sadly domain reloading sometimes chugs it up to 20sec when I try to immediately enter play mode. Not sure what's going on there. Can't wait for any improvement.

 

On the Discord server it was commented that part of the domain reload problem is because of the Visual Script that was added. in the next updates they should fix this for those who do not use Visual Script

 

So after the update, anyone who uses a little bit of bolt ends up with sluggish domain reload?

 

About Assembly reloads and script compilation, we are suffering it A LOT A LOT A LOT
our scripts takes to compile and assembly reload even sometimes like 8 minutes

we are afraid to change code or do small changes tests, since we can afford the time compsumition of that

also our project is PRETTY Big to thats what makes it worse

it also get slow sometimes when trying to do play

 

They don't know what broke so please use that tool https://forum.unity.com/threads/any...pt-assembly-reload-time.1117138/#post-7235969 and file a bug report to help them identify the regressions.