Search Unity

Submodules don't work, and Organization Repos are not selectable with Oauth????

Discussion in 'Unity Build Automation' started by Steamc0re, Jul 31, 2019.

  1. Steamc0re

    Steamc0re

    Joined:
    Nov 24, 2014
    Posts:
    144
    So , we're using submodules and they are not working at all. We've noticed locally the git@git syntax does not work in our .gitmodules file, we have to use https://

    Can we please get a fix?
    Code (CSharp):
    1.  Submodule 'Assets/IPL/Core' (git@github.com/virtualhq/IPL.Core.git) registered for path 'Assets/IPL/Core'
    2. 23: Submodule 'Assets/IPL/Photon' (git@github.com/virtualhq/IPL.Photon.git) registered for path 'Assets/IPL/Photon'
    3. 24: Submodule 'Assets/IPL/PlayFab' (git@github.com/virtualhq/IPL.PlayFab.git) registered for path 'Assets/IPL/PlayFab'
    4. 25: Submodule 'Assets/IPL/WebRTC' (git@github.com/virtualhq/IPL.WebRTC.git) registered for path 'Assets/IPL/WebRTC'
    5. 26: fatal: repository 'git@github.com/virtualhq/IPL.Core.git' does not exist
    6. 27: fatal: clone of 'git@github.com/virtualhq/IPL.Core.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Core' failed
    7. 28: Failed to clone 'Assets/IPL/Core'. Retry scheduled
    8. 29: fatal: repository 'git@github.com/virtualhq/IPL.Photon.git' does not exist
    9. 30: fatal: clone of 'git@github.com/virtualhq/IPL.Photon.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Photon' failed
    10. 31: Failed to clone 'Assets/IPL/Photon'. Retry scheduled
    11. 32: fatal: repository 'git@github.com/virtualhq/IPL.PlayFab.git' does not exist
    12. 33: fatal: clone of 'git@github.com/virtualhq/IPL.PlayFab.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/PlayFab' failed
    13. 34: Failed to clone 'Assets/IPL/PlayFab'. Retry scheduled
    14. 35: fatal: repository 'git@github.com/virtualhq/IPL.WebRTC.git' does not exist
    15. 36: fatal: clone of 'git@github.com/virtualhq/IPL.WebRTC.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/WebRTC' failed
    16. 37: Failed to clone 'Assets/IPL/WebRTC'. Retry scheduled
    17. 38: fatal: repository 'git@github.com/virtualhq/IPL.Core.git' does not exist
    18. 39: fatal: clone of 'git@github.com/virtualhq/IPL.Core.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Core' failed
    19. 40: Failed to clone 'Assets/IPL/Core' a second time, aborting
    20. 41: fatal: repository 'git@github.com/virtualhq/IPL.Photon.git' does not exist
    21. 42: fatal: clone of 'git@github.com/virtualhq/IPL.Photon.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Photon' failed
    22. 43: Failed to clone 'Assets/IPL/Photon' a second time, aborting
    23. 44: fatal: repository 'git@github.com/virtualhq/IPL.PlayFab.git' does not exist
    24. 45: fatal: clone of 'git@github.com/virtualhq/IPL.PlayFab.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/PlayFab' failed
    25. 46: Failed to clone 'Assets/IPL/PlayFab' a second time, aborting
    26. 47: fatal: repository 'git@github.com/virtualhq/IPL.WebRTC.git' does not exist
    27. 48: fatal: clone of 'git@github.com/virtualhq/IPL.WebRTC.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/WebRTC' failed
    28. 49: Failed to clone 'Assets/IPL/WebRTC' a second time, aborting
    29. 50: ! checkout failed. /usr/local/bin/git  clone '--branch' 'master' '--recursive' '--' 'git@github.com:virtualhq/IPL.Remotely.git' '/BUILD_PATH/kenny-roy.vhq_unity.remotely/'  2>&1:Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely'...
    30. 51: Checking out files:  37% (2067/5487)  
    Also, I am not the owner of the repos at the company I'm working for: I am an admin of their git org, and they show up in git client as org repos. I would like to try to resolve this using Oauth, or at least test if the behavior is the same, but I need Cloud Build to recognize org repos in order to do so.

    Can we get a fix for this too please?
     
  2. Steamc0re

    Steamc0re

    Joined:
    Nov 24, 2014
    Posts:
    144
    Some change we just did changed the @git syntax to https:// but now there's a new problem. Username does not exist?

    Can I get some feedback on this error?
    Code (CSharp):
    1.  Submodule 'Assets/IPL/Core' (https://github.com/virtualhq/IPL.Core.git) registered for path 'Assets/IPL/Core'
    2. 23: Submodule 'Assets/IPL/Photon' (https://github.com/virtualhq/IPL.Photon.git) registered for path 'Assets/IPL/Photon'
    3. 24: Submodule 'Assets/IPL/PlayFab' (https://github.com/virtualhq/IPL.PlayFab.git) registered for path 'Assets/IPL/PlayFab'
    4. 25: Submodule 'Assets/IPL/WebRTC' (https://github.com/virtualhq/IPL.WebRTC.git) registered for path 'Assets/IPL/WebRTC'
    5. 26: Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Core'...
    6. 27: fatal: could not read Username for 'https://github.com': Device not configured
    7. 28: fatal: clone of 'https://github.com/virtualhq/IPL.Core.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Core' failed
    8. 29: Failed to clone 'Assets/IPL/Core'. Retry scheduled
    9. 30: Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/PlayFab'...
    10. 31: fatal: could not read Username for 'https://github.com': Device not configured
    11. 32: fatal: clone of 'https://github.com/virtualhq/IPL.PlayFab.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/PlayFab' failed
    12. 33: Failed to clone 'Assets/IPL/PlayFab'. Retry scheduled
    13. 34: Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Photon'...
    14. 35: fatal: could not read Username for 'https://github.com': Device not configured
    15. 36: fatal: clone of 'https://github.com/virtualhq/IPL.Photon.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Photon' failed
    16. 37: Failed to clone 'Assets/IPL/Photon'. Retry scheduled
    17. 38: Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/WebRTC'...
    18. 39: fatal: could not read Username for 'https://github.com': Device not configured
    19. 40: fatal: clone of 'https://github.com/virtualhq/IPL.WebRTC.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/WebRTC' failed
    20. 41: Failed to clone 'Assets/IPL/WebRTC'. Retry scheduled
    21. 42: Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/PlayFab'...
    22. 43: fatal: could not read Username for 'https://github.com': Device not configured
    23. 44: fatal: clone of 'https://github.com/virtualhq/IPL.PlayFab.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/PlayFab' failed
    24. 45: Failed to clone 'Assets/IPL/PlayFab' a second time, aborting
    25. 46: Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/WebRTC'...
    26. 47: fatal: could not read Username for 'https://github.com': Device not configured
    27. 48: fatal: clone of 'https://github.com/virtualhq/IPL.WebRTC.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/WebRTC' failed
    28. 49: Failed to clone 'Assets/IPL/WebRTC' a second time, aborting
    29. 50: Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Photon'...
    30. 51: fatal: could not read Username for 'https://github.com': Device not configured
    31. 52: fatal: clone of 'https://github.com/virtualhq/IPL.Photon.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Photon' failed
    32. 53: Failed to clone 'Assets/IPL/Photon' a second time, aborting
    33. 54: Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Core'...
    34. 55: fatal: could not read Username for 'https://github.com': Device not configured
    35. 56: fatal: clone of 'https://github.com/virtualhq/IPL.Core.git' into submodule path '/BUILD_PATH/kenny-roy.vhq_unity.remotely/Assets/IPL/Core' failed
    36. 57: Failed to clone 'Assets/IPL/Core' a second time, aborting
    37. 58: ! checkout failed. /usr/local/bin/git  clone '--branch' 'master' '--recursive' '--' 'git@github.com:virtualhq/IPL.Remotely.git' '/BUILD_PATH/kenny-roy.vhq_unity.remotely/'  2>&1:Cloning into '/BUILD_PATH/kenny-roy.vhq_unity.remotely'...
    38. 59: Checking out files:  26% (1415/5258)  
     
  3. Steamc0re

    Steamc0re

    Joined:
    Nov 24, 2014
    Posts:
    144
    Googling seems to return something about the https protocol needing Username param for authentication, since this is an organization Repo, that would fail too.

    Am I on the right track with my thinking?
     
  4. victorw

    victorw

    Joined:
    Sep 14, 2016
    Posts:
    459
    HTTPS repos have to use Oauth for authentication, SSH repos have to use SSH keys for authentication. You will either have to configure Oauth access and ensure that the user you configured this with also has access to the submodule repos, or configure the repo to use SSH with the UCB SSH key granted access to all the submodule repos.

    Barring weird new API bugs, organization repos are recognized by Oauth however due to Github's permissions schema you need to have admin-level access to the repo in order to complete the initial configuration.
     
  5. Steamc0re

    Steamc0re

    Joined:
    Nov 24, 2014
    Posts:
    144
    So I decided to add myself to each repo instead of just being owner and admin of the org, and this morning the projects finally showed up. If that's what fixed it, I am not sure because I can see other org repos that I didn't add myself to alongside the ones in question.

    Trust me when I say that they were NOT showing up before. We've had company meetings where each member of org tried to use their git login while on the Cloud Build dashboard, and went as far as debating whether we should transfer the org repos to a single new user instead. This has been a daily conversation for well over a week, and we've been testing oAuth and SSH the whole time. So again, something did change, this is not a matter of us not fully trying it before complaining. It just doesn't make sense that adding myself to the repos is it because I can see ALL org repos now.