Search Unity

Official Changes to the Graphics GitHub repository

Discussion in 'General Graphics' started by ali_mohebali, Dec 28, 2020.

Thread Status:
Not open for further replies.
  1. ali_mohebali

    ali_mohebali

    Unity Technologies

    Joined:
    Apr 8, 2020
    Posts:
    119
    Hi all, we hope you are enjoying your holidays, wherever you may be.

    We would like to share an important update with you.

    Effective 28th Dec 2020 and in accordance with changes to Unity source code hosting policies, we are migrating the Graphics GitHub repository (https://github.com/Unity-Technologies/Graphics) to our internal GitHub Enterprise instance. The current GitHub repository will not be removed and it will be still available for those who need it. However as part of the migration process, the current Graphics repository will be set to read-only.

    There will be a Unity blog post with information on the upcoming changes in the next few days. So please stay tuned for more details.

    UPDATE:
    Thank you for your patience. We totally understand the frustration around this and we did not intend to have this happen over the holiday break when a lot of us weren't available to communicate with you. In light of this situation, we have reverted the change and set the graphics repository back to an active state.

    For full disclosure, this was part of a larger source code policy change we were planning on rolling out internally to strengthen our programs and processes around source code and sensitive information. The plan was to migrate the existing source code repositories from Github.com to our GitHub Enterprise instance and set the public repos to read-only so they would still be available to reference and grok the code but not used for active development.

    After evaluation, we're going to put a pause on this whole transition and spend some time with the community to better understand your concerns and feedback.
     
    Last edited: Jan 7, 2021
  2. SugoiDev

    SugoiDev

    Joined:
    Mar 27, 2013
    Posts:
    395
    We can no longer follow the development in the internal GitHub instance?
    Will this happen to everything else Unity is currently publishing on GH?

    Being able to follow the development closely is important to me, and I'm sure to many others.
    Will there be a another way for us to do that?


    Best of luck on the migrations!
     
  3. alexanderameye

    alexanderameye

    Joined:
    Nov 27, 2013
    Posts:
    1,383
    Yeah I hope this will still be possible, looking at PR's has become a daily routine :)
     
  4. Mauri

    Mauri

    Joined:
    Dec 9, 2010
    Posts:
    2,665
    Well... GitHub Enterprise is meant for running on an organization's local network only (see this FAQ), so don't get your hopes too high up. But let's just wait and see what the announced blog post will say.
     
    Tanner555 and alexanderameye like this.
  5. rz_0lento

    rz_0lento

    Joined:
    Oct 8, 2013
    Posts:
    2,361
    I've been extremely worried about this happening ever since Unity started to message they are going more closed for early versions again. So far the messaging has been that Graphics repo isn't going away but apparently our fears still came true :/

    I've hoped for the opposite for a long time (that more of the Unity packages would go to github) as it's enabling me as a developer as I can cherrypick commits manually and test individual changes early on. Now this change means that we will not be able to access individual commits again and it's making it a major pain to find and revert individual changes that introduce new bugs (which has been the situation throughout the existence of HDRP for example, this is going to hurt a lot now as everything that breaks will become slower to fix manually).

    I really hope there is some way to get access these commits still but I'm not holding my breath. Sad day :/
     
    Last edited: Dec 29, 2020
  6. fherbst

    fherbst

    Joined:
    Jun 24, 2012
    Posts:
    802
    This is a sad day and another blow at everyone who's actually believing in the SRPs, building on them, trying to understand and even actively improve them. WHY

    @ali_mohebali can you please elaborate on
    ? I'm not aware of these changes, I just know that Unity recently talked a lot about "embracing and supporting open source", "making our process more visible", and so on - this is the opposite.
     
  7. m0nsky

    m0nsky

    Joined:
    Dec 9, 2015
    Posts:
    257
    So, if I understand this correctly: from now on every time you want access to the latest HDRP/URP code, you will have to wait for the next Unity engine release, extract the bundled SRP from %appdata% cache, and you will be greeted with a surprise of (possibly breaking) changes, since we're now blind and can't follow what's going on. To apply your own changes, you will have to copy and paste your own changes to every file manually, since we lose forks/merges.

    Do our complaints mean anything in this situation? Because I think this is a very big mistake.
     
    Last edited: Dec 29, 2020
  8. BattleAngelAlita

    BattleAngelAlita

    Joined:
    Nov 20, 2016
    Posts:
    400
    Hope with this step they wipe that HDRP/URP nonsense, and make the GRP(GoodRenderingPipeline)
     
  9. Neto_Kokku

    Neto_Kokku

    Joined:
    Feb 15, 2018
    Posts:
    1,751
    Will the public Github repo be at least updated from time to time, or is the package manager going to be the only way to see the latest code going forward?

    -- EDIT --

    Looked it up and it's really dead:
    Source: https://github.blog/2017-11-08-archiving-repositories/
     
    MadeFromPolygons likes this.
  10. rz_0lento

    rz_0lento

    Joined:
    Oct 8, 2013
    Posts:
    2,361
    from https://forum.unity.com/threads/srp-repository-migration.861625/:
    Any chance we get the old repo back as read-only as well? That offline for backup turned out to be quite permanent and now new Graphics repo had a really short life-span. There's a ton of history on the original SRP repo.
     
    m0nsky and LooperVFX like this.
  11. LooperVFX

    LooperVFX

    Joined:
    Dec 3, 2018
    Posts:
    180

    Attached Files:

    bzor likes this.
  12. rz_0lento

    rz_0lento

    Joined:
    Oct 8, 2013
    Posts:
    2,361
    MadeFromPolygons likes this.
  13. ph_

    ph_

    Joined:
    Sep 5, 2013
    Posts:
    232
    Like many others, this will impact my day to day workflow immensely.

    Any bit of momentum that the SRPs might have got in this last year will be effectively killed by this move.
     
  14. Mauri

    Mauri

    Joined:
    Dec 9, 2010
    Posts:
    2,665
    Last edited: Dec 30, 2020
    rz_0lento likes this.
  15. jbooth

    jbooth

    Joined:
    Jan 6, 2014
    Posts:
    5,461
    Unity has become down right hostile towards those of us trying to keep shaders running in URP/HDRP - I'm pretty sure they are actively trying to make it harder for us, hoping we'll switch over to a shader graph or move to other engines. I used to have some faith that the graphics team meant well, but had just taken some wrong turns- but that's pretty much eroded by this point. I had a meeting with Natasha in August, and it was a lot of promises of getting some plans to me and being available if I had questions or concerns, and the plans never materialized and emails have gone un-answered. There was also a ton of hand waving in that meeting about why having a shader abstraction was "hard", and I believed about none of it- talks of changing shader languages, mesh shaders, etc, somehow making it impossible to abstract away what is effectively two functions the shader graph writes already. I suspect the entire thing was just to try to make SRPLife go away, but the thing that makes that go away is NOT consistently making it worse and not communicating with anyone about anything.

    The page of "Upgrade notes" doesn't cover half the changes, and basically is written by someone expecting you to already be familiar with every detail of their shader stack, not something that actually helps you fix the practical issues you run into. For instance, I recently updated MicroSplat HDRP to compile under 2020.2's version of HDRP, and the actual compile errors I hit were not in the notes at all. Meanwhile, I suspect it's a week or two of work to actually finish the job, if not more.

    Unity keeps proving over and over that they simply do not care about these issues. They come out once every six months and say a lot of words to try to calm things, but they have not followed any of it up with actual action, nothing is being done, and nothing is likely to be done. I'd love to be wrong on this, but I'm doubtful.
     
  16. Shizola

    Shizola

    Joined:
    Jun 29, 2014
    Posts:
    476
    This is the worst way to announce things like this.
     
  17. Kolyasisan

    Kolyasisan

    Joined:
    Feb 2, 2015
    Posts:
    397
    I don't like this at all. What boons does it even bring? I liked it being publically visible on github.
     
    Last edited: Dec 30, 2020
  18. StaggartCreations

    StaggartCreations

    Joined:
    Feb 18, 2015
    Posts:
    2,266
    Can't say I'm too happy about this, not at all in fact. This amounts to a blow to asset store publishers, who are most required to stay ahead of breaking changes. The PR list allows us to peer into current development beyond what the rather simplistic roadmap offers.

    I can honestly only accept this decision if it brings forth a new communication strategy, where we can expect detailed changelogs and upgrade guides between versions. But given how this hasn't improved, despite being promised time and again over the past two years, I'm far from optimistic (please prove me wrong!). Ever since SRP landed we've been required to piece together all kinds of information based on the repo as the only alternative, which we're now being robbed of.

    Hopefully the blog post will shed some light on this.
     
  19. Nothke

    Nothke

    Joined:
    Dec 2, 2012
    Posts:
    112
    I really don't understand who benefits from this? It seems like a lose-lose situation. I'd really love to know the reasoning behind this decision, I'm only imagining it as a scene from Ryan George's Pitch Meeting. I hope we find that out in the blog post.
     
  20. BattleAngelAlita

    BattleAngelAlita

    Joined:
    Nov 20, 2016
    Posts:
    400
    Hiding repository means that unity guys don't want the community to see the changes. This can means:
    1 wipe HDRP/URP and make new one GoodRP
    2 $$$ for repository access
    3 hide that some features sit in PR for years and don't release
     
  21. Kirsche

    Kirsche

    Joined:
    Apr 14, 2015
    Posts:
    121
    The purpose of doing this seems to be shielding them from criticism. Especially when we consider that other big mainstream engines give you source code access for free.
     
  22. SudoCat

    SudoCat

    Joined:
    Feb 19, 2013
    Posts:
    65
    This sucks. I'm starting to feel like I backed the wrong horse. Unity management seem very committed to making increasingly bad, erratic decisions.
     
  23. rz_0lento

    rz_0lento

    Joined:
    Oct 8, 2013
    Posts:
    2,361
    I love access to these things too. For example there's CMAA2 integration for HDRP sitting on one branch of that repo that can be upgraded to latest HDRP version with few lines of code and is valuable despite Unity never merging it.
     
  24. cfree

    cfree

    Joined:
    Sep 30, 2014
    Posts:
    72
    Sincerely, there is no surprise at all... it is just Unity being Unity, as always.
     
    Tanner555 and Lavanda49GS like this.
  25. AlexeyDrobyshevsky

    AlexeyDrobyshevsky

    Joined:
    Sep 28, 2016
    Posts:
    37
    ... did you feel that 2020 hadn't sucked enough, and decided to add a little extra oomph just before it ended? This sounds like really bad news with no silver lining whatsoever. Please consider reversing this decision, or at least giving us some other way to follow graphics development as it happens.
     
  26. mgear

    mgear

    Joined:
    Aug 3, 2010
    Posts:
    9,443
    how about next time the blog post, forum topic, questionnaires or other info would come first, before suddenly closing things?
     
    florianBrn, Ruslank100 and LooperVFX like this.
  27. dotsquid

    dotsquid

    Joined:
    Aug 11, 2016
    Posts:
    224
  28. equalsequals

    equalsequals

    Joined:
    Sep 27, 2010
    Posts:
    154
    This is tragic. We maintain local forks of repos for packages like ShaderGraph to support fixes and feature improvements which don't come online fast enough. This leaves us in a very painful position. @Tim-C what are the suggestions for moving forward for a scenario like this?
     
  29. PhilSA

    PhilSA

    Joined:
    Jul 11, 2013
    Posts:
    1,926
    Does that mean the public Graphics repo will still show all the new commits being made, but it's just not gonna accept pull requests?
     
  30. rz_0lento

    rz_0lento

    Joined:
    Oct 8, 2013
    Posts:
    2,361
  31. Neto_Kokku

    Neto_Kokku

    Joined:
    Feb 15, 2018
    Posts:
    1,751
    That one has been effectively dead for a while now.
     
    Tanner555 likes this.
  32. benthroop

    benthroop

    Joined:
    Jan 5, 2007
    Posts:
    263
    This is super disappointing and communicated horribly. Seeing all these committed devs freaking out when they've done so much to support Unity's ongoing efforts, all for a boot in the face.

    This reeks of lawyers coming in and exerting because "publicly traded". "What if you invent some new technique and it's been on the public Github. You can never patent it..."

    Just another reason I'm staying away from the SRPs for as long as possible.
     
  33. xgonzal2

    xgonzal2

    Joined:
    Jul 3, 2012
    Posts:
    62
    Yet another terrible decision managing SRP. It's like they are trying their best to make this fail. I really don't envy asset developers right now as this is a real nightmare situation.

    Given their huge lack of communication with SRP, having access to their PRs gave me accurate information on what they've done, were working on, and also allowed me to bring in bug fixes to my fork of URP without having to wait an eternity for them to publish those changes. To see this level of access go away is incredibly sad.
     
  34. laurentlavigne

    laurentlavigne

    Joined:
    Aug 16, 2012
    Posts:
    6,363
    If it means that SRP is about to become (real) production ready then I'm cool with it.
    The only scenario where this is ok is when URP and HDRP are feature locked and stable.
     
    Edy likes this.
  35. MadeFromPolygons

    MadeFromPolygons

    Joined:
    Oct 5, 2013
    Posts:
    3,982
    This is an awful decision that does very little for the community other than shows that the graphics team are completely unaware of what the userbase wants and needs

    Does anyone at unity even talk to the community anymore? It really seems like you are on a mission to get rid of any commercial users of the engine and be left with a bunch of hobbyists - good luck to you on that I really can't see the engine being around in 5 years based on the ridiculous choices you keep on making
     
    Last edited: Dec 30, 2020
  36. fherbst

    fherbst

    Joined:
    Jun 24, 2012
    Posts:
    802
    I hope the blog post will resolve all that confusion (Fingers crossed! Remember, these are the good guys!).

    For this and other packages, there's actually an alternative to the Unity repos: for a while, @marwi and me have been trying to counter this back-and-forth approach to packages — until Unity has figured out something better, I can just point those of you who actually work with packages (not just consume them) to our Needle Mirror.

    All released packages (including the SRPs of course) are mirrored there, license permitting, and you can diff/fork/read there as needed.
    Links to the UPM Package Mirror: Forum PostGitHub OrgTwitter Bot
     
  37. PhilSA

    PhilSA

    Joined:
    Jul 11, 2013
    Posts:
    1,926
    I really appreciate Needle Mirror, but it's also not completely solving the problem here. Lots of people need to see the commits being made on the packages before the packages themselves are released, so they can see where things are going and anticipate the changes in their own projects
     
  38. fherbst

    fherbst

    Joined:
    Jun 24, 2012
    Posts:
    802
    @PhilSA I fully agree! It's not a full solution, especially not for anticipating changes before they are released.
    I think this hurts with the SRPs specifically, as they have been notoriously bad at providing preview releases - which are "by design" the mechanism for seeing changes before the general public sees them.
     
  39. TwiiK

    TwiiK

    Joined:
    Oct 23, 2007
    Posts:
    1,729
    They're getting rid of the hobbyists as well at this rate, or to be honest I would think we were the first to go as we have no financial incentive to spend time finding workarounds for broken or missing features. We just want to have fun making games. I've been making hobby projects in Unity since 2007 and for the most part I've always felt sure of my choice of engine. That is it has felt like I was learning stuff worth learning and that I could at any point use what I had learned to turn one of my hobby projects into a commercial project some day, but for the last couple of years that hasn't been the case. Now using Unity is starting to feel more and more like my web development day job where it feels like I'm betting on the wrong javascript framework and that I'm spending my time learning things that get me nowhere because they'll be replaced by something new and better (read: different) before I have the time to use them anyway. And to make matters worse not only are features getting replaced, there are always multiple choices for what I could be learning, and I have no idea which option is the correct one. Which is just stressful and not enjoyable at all.

    And for me by far the worst part in all of this is seeing the community become more and more fractured with every passing day as other Unity developers are making their own choices on which features to bet on.
     
  40. Kolyasisan

    Kolyasisan

    Joined:
    Feb 2, 2015
    Posts:
    397
    Imaginitive good ending: UT prepares to open-source the C++ and C# sides of the engine for the common development folk and this is just a preparation before allowing people to dig in, similar to how UE has all of its source code behind private git repos and you need to accept the license before viewing them.

    ...yeah, i wish
     
    Last edited: Dec 31, 2020
  41. LooperVFX

    LooperVFX

    Joined:
    Dec 3, 2018
    Posts:
    180
    . . . . _.---._ . . . .
    . <.‾_ ‾‾‾‾ _‾.> .
    . . . . . ‾‾‾‾ . . . . .
    . I . WANT . TO .
    . . . BELIEVE . . .
     
  42. markefus

    markefus

    Joined:
    Nov 2, 2014
    Posts:
    22
    I think this is a terrible loss for the development community, especially given the scarcity of documentation, and I wish Unity would reconsider.
     
    Tanner555 and elJoel like this.
  43. MechaWolf99

    MechaWolf99

    Joined:
    Aug 22, 2017
    Posts:
    294
    I really dislike this. I liked to look at it to help understand how the SRP worked, and how they did things. I also used to as a general learning resource, for just general Unity stuff, and for shader related things. Right now it is also the only place to see the GraphView API in use.
    It has been extremely helpful and interesting to look at it, even with simply having better docs and changelogs, imo they couldn't replace actually being able to look at the source!
     
    Tanner555 likes this.
  44. JohnAustinPontoco

    JohnAustinPontoco

    Joined:
    Dec 23, 2013
    Posts:
    283
    Good lord, what a terrible idea. Our team maintains reams of changes on top of the SRP and InputSystem repositories that we faithfully rebase whenever we upgrade. The open source repositories are the only reason you can build a mid-sized game with Unity at the moment -- it's what lets Unity compete with the open-source engine of UE4.

    It's critical to be able to see the commit logs and history for the graphics repository. We often backport bugfixes ourselves from later versions. Copy-pasting from the Packages folder is not at all a reasonable solution. It makes rebasing an absolute nightmare.

    Surely you all could turn the public repository into a mirror version of the internal source. Why make the whole thing closed source?
     
  45. pragmascript

    pragmascript

    Joined:
    Dec 31, 2010
    Posts:
    107
    How exactly does this move benefit your customers?
     
  46. alexanderameye

    alexanderameye

    Joined:
    Nov 27, 2013
    Posts:
    1,383
    I mean, maybe they'll do this? move the development to an internal repo but keep a read-only mirror public?
     
    Noisecrime, Ruslank100 and fherbst like this.
  47. slime73

    slime73

    Joined:
    May 14, 2017
    Posts:
    107
    The public repo is archived rather than just read-only - I believe archived repositories can't be pushed to, so it's no longer even a mirror.
     
    Tanner555 and MadeFromPolygons like this.
  48. Yetman

    Yetman

    Joined:
    Jan 29, 2016
    Posts:
    5
    But Why???? What would even be the benefit of doing this?
    Given how incomplete and volatile the graphics packages are, it was really useful to get a glimpse of the development direction of the SRPs and to get some examples of the weakly documented parts of Unity's API.
    I guess I'll have to wait and see if the blog post will present a convincing rationale for such a decision.
     
  49. spryx

    spryx

    Joined:
    Jul 23, 2013
    Posts:
    557
    Usually blog posts for major announcements. Here's to hoping they are going semi-open source.

    Then again...could just be another "road to 2021 post...."
     
    Tanner555 likes this.
  50. jbooth

    jbooth

    Joined:
    Jan 6, 2014
    Posts:
    5,461
    Most likely it'll be an announcement about their big inroads to dental imaging apps, along with a special service you can pay for to make it easier to render teeth..
     
Thread Status:
Not open for further replies.