[Fix Out] Checking for changes

Looking forwards!!

 

I've read the same thing from other Unity teams as well...

Are... are you sure the package manager was a good idea?

In any case, good luck with the release.

We're still using collaborate, but generally only because I haven't gotten the time to invest in a new solution, so I'm hoping that with this update collaborate will finally start working a bit better and save me from the trouble

 

Thank you for the progress update, @ryan_unity, and that is great news. I do not want to be greedy (seeing that infernal 'Checking for Changes' progress bar for the last time will be fantastic), but do you know if the fixes will have an impact on the issue of the Unity Editor hanging for a while after each Collaborate update?

Thanks,
Matt

 

Thanks for the update @ryanc-unity !
Will download 2018.3.10 when it's ready.

 

You need to backport this to 2017.4. It is your *only* LTS release so far, after all.

Otherwise it demonstrates that having a version control system thoroughly integrated into the editor is a bad idea, and that a 3rd-party solution (ie. Git) is the best approach.

 

*cough* ?

 

Unity 2018.3.10, check! Standing by for Collaborate v2.0.0 package.

 

Amazing! One day they will be able to display numbers bigger than 9!

But come on Collaborate! Package please

 

Ok, I see 2.0 is inPreview, is it stable or we may better wait some more?

Great news, anyway!!

 

Hmm... with Unity 2018.3.10 and the v2.0 Collaborate package, taking a 1KB update still locks up the editor for almost 2 minutes:

Any additional debug info I can provide? Network connection is strong.

Project size is ~50MB:



Project file count is ~5,000 files:



(The monkeys folder is just a bunch of copies of a little .jpg of a monkey, to simulate a normal project file count total.)

Here's the project:
https://www.dropbox.com/s/quccbxt71voh3g3/Collaborate Speed Testbed.zip?dl=0

Bug Case ID 643900:
https://support.unity3d.com/hc/en-us/requests/643900

Project UPID:
93a7b321-cb1d-4ab0-919b-92bfa2c7e399

 

Hi @RyanC, the slow-to-update test case project size is ~50MB:



Here's the project:
https://www.dropbox.com/s/quccbxt71voh3g3/Collaborate Speed Testbed.zip?dl=0

But, the project file count is just over 5,000.

Hmm... maybe the issue is:

• [COL-353] Projects with a large number of files (~8000+) may see high CPU usage when file changes are made within the project.

My team has had good luck getting all of our total project file sizes down below 2GB, but we've not been able to get those same projects' file count below about 5,000 files total.

Bug Case ID 643900:
https://support.unity3d.com/hc/en-us/requests/643900

Project UPID:
93a7b321-cb1d-4ab0-919b-92bfa2c7e399

 

After only doing some limited testing with v2.0 today, I ended up reverting back to 1.2.16. It seems like v2.0 is a bit of a CPU hog (even if Unity isn't in focus), and often times unexpectedly will spike the CPU to ~50% even when idling on a blank/new test scene.

Is there a reason why v2.0 appears to be significantly less efficient than previous versions of Collaborate?

 

Had a great moment this morning when I saw that a new version of Collaborate got available witn 2018.3.10. And now, having bad times in El Collaborate. CPU usage is ridiculously high and working is almost impossible. We had to down-grade too. Too bad.

 

I'm guessing it's because it's Async.

I also found that instead of popping up "checking for changes" every 15 minutes as it usually does, now it does it in the background, which would be fine, but it makes the editor almost unresponsive anyway, so not sure what I gained by upgrading to the 2.0.0 package.

 

Hm, I guess we will be staying with the old version for now...

 

So I tried it once more, thinking, maybe I was too quick to jump to conclusions, maybe I was affected by the previous posters, maybe if I wait a bit the cpu usage will settle.

So I tried again on a Mac this time...

Now collaborate doesn't even work properly. I can pull changes done in other computers, but I can never push changes. I change stuff, and the icon never changes to the blue icon that lets me upload.

I thought I'd wait, maybe it was doing a "checking for changes" in the background, and that would finish, but I've been waiting for around 25 minutes and I still can't upload anything.

 

Tried again with the newly released 2018.3.11, same thing, doesn't work.

 

@StaceyH @ryanc-unity

Some more data points:

1. In a new empty project, 2.0.0 was working fine (well, cpu was high)

2. After that I re-opened my main project, upgraded to package 2.0.0, and... it was working (?!). Like immediately, it was showing it wanted to upload the manifest, and as soon as I did a change, that one was added to the list like it should.

3. I closed Unity and re-opened it. Now Collaborate was not working again, it stayed with the Green icon no matter what changes I did locally. Remote changes were coming in properly though as I mentioned previously.

4. I tried disabling and re-enabling collaborate and it popped up a "Hold on. Preparing your project for collaborate" dialogue. I think it's stuck there (I've waited 20+ minutes). Weirdly, the editor is functional behind the progress bar.

5. The mac is a 2012 mac mini running 10.14.3. It has 16gb of ram a 2.7ghz i7 and an SSD. I mean it's an old machine, but it's not really that slow.

6. I didn't do extensive testing on Windows, but Collaborate was working there in the test I did yesterday. I'll try again later and update here.

7. CPU usage is generally crazy high:

but sometimes it's less than that (like in the 150-200% range). It's like it has two modes. At first I thought it had something to do with whether it was working properly or not, but it doesn't.

EDIT: 8. Other stuff like rolling back to previous commits does work fine.

 

Clarification: It's not that it never seems to update, it always updates for incoming changes, it doesn't update for local changes, as such I am not able to upload stuff. (but everything else works)

I tried it now, it didn't change anything.

You should already have our project from a different ticket/bug report from months ago (the freezing/hanging issues on Windows), but sure, I'll message you the UPID in a bit.

 

Sincere thanks for the update.

Not a ton of us are commenting but many of us are definitely monitoring. Collaborate is definitely in a messy state it feels like from my team's perspective, and I imagine that stretches towards most teams using it, so being informed of the progress on this is a make or break for many of us at this point.

 

Was so disappointed with the 2.0 update we took a day to move everything to github. Should have done it a long time ago, Collab is nothing but a disaster.

 

I'm experiencing the same thing AcidArrow is with 2.0. Even though I know I have changes, it indicates I am up to date and doesn't detect I have anything to publish.

 

Are you also on a Mac? Also how big is your project roughly?

 

Hi, yes, that's the issue. Adding these makes Collaborate work reasonably fast (it takes a couple of minutes to see the local changes the first time).

Although there is another potential issue. I'm guessing something changed between versions, I'm guessing you previously had it hardcoded to only look in a couple of folders and now it relies more on .collabignore.

So the problem is, there are other folders in the project. The memory profiler keeps snapshots in a "MemoryCaptures" folder. Screenshots we grab get put into a "ScreenShots" folder.

These are not things that we wanted versioned and uploaded to collab and I'm not crazy about having to add everything to .collabignore.

 

I was hoping that maybe there was a free win here, but unfortunately (at least in my case) all of these lines both are currently part of my project's ignore file and were back when I was running my previous v2.0 tests, so the reported CPU issues were unrelated to missing default ignore rules.

Are the missing lines other people may be experiencing due to another new v2.0 bug?

 

Looks like maybe my collabignore was updated. My custom ignore rules are no longer there and the all the rules posted above are in there. So that will not help with my issue.

@AcidArrow I am on windows and my project size is rather large.

 

I do have the txt file backup and saw that but I also had my own backup of the project specific ignores I created so I just put them back in from that.

I have a few things I am going to try over the next day or 2. Depending on the outcome of that, I will either update here or send a support email.

 

Is there an update to when 2.0 is presumed to be stable? Preview 8 is not viable for me since it keeps eating 30% of my CPU (i7 7700K) and makes the Unity Editor scene view FPS very low.

 

So @ryanc-unity, how goes the testing? In case you can't tell, we're eager for an update

 

I am triple-eager!

 

I'm experiencing a problem where it looks as though collab is scanning but nothing happens.
If I open the Collab window there's a please wait & scanning for changes message but having left this running for 2 hours nothing happens which means I cant upload changes.
Currently trying 2.0.0 preview 12.

EDIT: There is no significant CPU usage to say that unity is actually doing anything (ie my full system is at 2% and editor shows 0.4%)

 

Hi @ryanc-unity Yes I have done both what you suggested. I should point out I was trying this on 2019.1.0.f2.
I'm currently downloading 2019.1.1f1 and will try again.

Thanks.

 

TLDR;
2.0.0 preview-12 seems ok so far in 2019.1.1f1.


Sorry, I already launched the project in 2019.1.1f1 before seeing your reply.
The latest version of unity crashed when I tried to open my project. When I tried a second time it opened the project but took over 2hrs to fire up. When it did get going there were lots of errors relating to some assets I own. I fixed these and removed a few things and restarted unity.
It then opened without errors and when I tried collab it worked
I had changed my .collabignore to reflect the base example one above but this included a lot of stuff I didnt want to include so I've changed collabignore to reflect the whitelist example above.
I will let you know if I encounter any problems but so far so good.

Thanks.