Search Unity

  1. Unity 2019.2 is now released.
    Dismiss Notice

AR Remoting & Simulation

Discussion in 'Handheld AR' started by mfuad, Aug 1, 2019.

  1. mfuad

    mfuad

    Unity Technologies

    Joined:
    Jun 12, 2018
    Posts:
    7
    Hi everyone, there have been a lot of conversations around reducing iteration time when working with AR Foundation. We owe the community an update and in an effort to improve our communication and transparency, we have created a dedicated post to keep you updated as we progress. You can expect more details to be posted on this thread moving forward.

    It’s clear from many of you that iteration time continues to be a significant pain point. Remoting is the most requested feature and we are currently solidifying our plan to ensure we have the tools that fit your needs. At a high level, we plan to include the following features:

    Remoting & Simulation:
    • Connect to a remote device from the editor
    • Test AR features (planes, raycast, reference points, etc.) on-device without having to build your app
    • Record sessions and play them back in the editor
    • Simulate AR features (planes, raycast, reference points, etc.) in the editor
    This is a large, comprehensive project that will take time and continue to evolve as new AR features are supported. However, we want to make sure you have the proper tools to test features you use the most, as soon as possible. We are working on this now, so stay tuned for more updates.
     
    zakpacha, Invent4, mbosoft and 12 others like this.
  2. Superdeath

    Superdeath

    Joined:
    Nov 6, 2013
    Posts:
    2
    Thanks for the update! Question about recorded sessions - is the idea that the raw video feed and full suite of sensor data will be recorded for playback and simulation? Would we basically be able to launch the recorded video + sensor data from editor and otherwise interact with the app via UI or other events normally?
     
  3. Dark_Swordsman

    Dark_Swordsman

    Joined:
    Dec 4, 2018
    Posts:
    27
    Thanks for the update. Not sure how far you guys are but it would be great if you could push out a preview as soon as possible. The recording feature is nice but a working preview of just the remoting (incl. raycasts) would already help tremendously.
     
    henriqueranj, R0man, jotamaza and 6 others like this.
  4. juliodutracora

    juliodutracora

    Joined:
    Jun 11, 2019
    Posts:
    13
    Agree.
     
  5. BuoDev

    BuoDev

    Joined:
    Nov 28, 2018
    Posts:
    44
    I basically just want to see changes happening in the editors hierarchy and to check variables in the inspector. Would help a lot to understand how AR Foundation works.
     
    BBIT-SOLUTIONS likes this.
  6. Hugoliv

    Hugoliv

    Joined:
    Dec 8, 2017
    Posts:
    2
    watching this.
     
  7. UniTaz

    UniTaz

    Joined:
    Dec 4, 2017
    Posts:
    4
    Looking forward to it too. Thanks mfuad for the update!
     
  8. adrian-taylor09

    adrian-taylor09

    Joined:
    Dec 22, 2016
    Posts:
    15
    Awesome that you guys are working on a solution. I’m really looking forward to the in-editor simulation of AR features as I can see this being useful for my projects.

    Is there any information you can give us about expected timeframes?
     
    cabrera-juan likes this.
  9. vincentfretin

    vincentfretin

    Joined:
    Jul 4, 2019
    Posts:
    6
    @BuoDev this may interest you, Satwant Singh published this video just a few days ago:
     
    sskenth and BuoDev like this.
  10. adrian-taylor09

    adrian-taylor09

    Joined:
    Dec 22, 2016
    Posts:
    15
    @vincentfretin Thanks for the video. Those are some really helpful assets. The creator of the Runtime Inspector asset has some really useful Unity tools (including an in game console tool) his GitHub page is worth a visit for sure

    https://github.com/yasirkula
     
  11. MrDos1

    MrDos1

    Joined:
    Dec 14, 2016
    Posts:
    19
    Hi! Thanks for the update, this was much needed.

    Although I greatly disagree with the approach. We know that when you announce to be willing to be more transparent but don't give any estimated release date, it's most likely because the development didn't start yet.
    I have the feeling this feature is passed beyond due by now, and is a good candidate for the new "nested prefab" type of feature, where everyone says it's gonna be soon but it takes years.

    Now there's an opportunity to change that, please release a WIP as soon, that will work for few people, help them out, then expend the support one by one instead of adding all the features at beforehand.
    Helping 10 people is still better than not helping.
    We want a preview package. We want a pre-alpha, a early access, whatever. Anything will be better than nothing, to solve your transparency problem.
     
    R0man and naiqus like this.
  12. Bastienre4

    Bastienre4

    Joined:
    Jul 8, 2014
    Posts:
    53
    Hello ! I'm also starting to play around with AR and not having this feature is a real bummer for newcomers. Please keep us informed of the current state of this solution ;).
     
  13. unnanego

    unnanego

    Joined:
    May 8, 2018
    Posts:
    82
    8th Wall have had AR Remote for more than a year...
     
    naokiijobs likes this.
  14. giorat96

    giorat96

    Joined:
    Aug 26, 2017
    Posts:
    2
    Any news on this project @mfuad ?
    Is it possible to be part of a pre-alpha of AR Foundation Remote?
     
  15. Shizola

    Shizola

    Joined:
    Jun 29, 2014
    Posts:
    190
    I'm new to AR and really surprised this isn't already a thing. The remote tool shown here
    is one the way or the one that doesn't work anymore? Must be a real pain to make a non trivial AR app without these kind of tools? Or is everyone just using another solution like 8th wall?
     
  16. DrSharky

    DrSharky

    Joined:
    Dec 7, 2016
    Posts:
    4
    No updates...
    I understand that the original post says it's a large feature and will take time. I get that the big new updates to AR Foundation might make it more difficult, and that it's a help for them to implement this in the first place.

    Making the thread, and then not posting any updates in over a month though. Why make the thread in the first place?
     
    Tarrag and unnanego like this.
  17. Reinier77

    Reinier77

    Joined:
    Feb 2, 2018
    Posts:
    3
    They wanted to be more transparent, but they've gone completely invisible :(
     
  18. chilipino

    chilipino

    Joined:
    Mar 27, 2019
    Posts:
    2
    Has anyone here attempted to create a remote app for AR Foundation? I'm curious to see if it'd be relatively straightforward port given that we have access to the ARKit Remote source.
     
  19. MaxXR

    MaxXR

    Joined:
    Jun 18, 2017
    Posts:
    67
    Hi @mfuad
    can you please release even alpha for this because i'd really help us save time?
    Dev AR atm with unity is painful :/
     
  20. hawken

    hawken

    Joined:
    Aug 22, 2013
    Posts:
    480
  21. StanK_

    StanK_

    Joined:
    Dec 5, 2017
    Posts:
    6
  22. thibautvdumont

    thibautvdumont

    Joined:
    Oct 6, 2015
    Posts:
    16
    To those who wonder why the community hasn't done anything about this, it's simple : closed sources. Considering Unity's build iteration time, ARFoundation is basically unusable as it is for any AR project that goes a bit beyond a table top game. I'm stuck with it atm, but I really regret upgrading from the ARKit plugin.
     
    AdrienMgm and henriqueranj like this.
  23. petey

    petey

    Joined:
    May 20, 2009
    Posts:
    1,289
    It seems like things have got a lot harder with AR since I was last using it over a year ago :(
    It's pretty frustrating to watch the keynote where they are happily making AR projects with the greatest of ease. Cut to the real world and it's nothing like that.
     
  24. rsodre

    rsodre

    Joined:
    May 9, 2012
    Posts:
    181
    I remember seeing a Unity video with remoting a long time ago, and now that I'm building my first AR app, I was like really? Not available yet?

    +1
     
  25. MaxXR

    MaxXR

    Joined:
    Jun 18, 2017
    Posts:
    67
    newguy123 likes this.
  26. henriqueranj

    henriqueranj

    Joined:
    Feb 18, 2016
    Posts:
    141
    In the Unity Roadmap @ Unite Copenhagen 2019 slides (https://on.unity.com/Unite2019RoadmapTalk), in page 62, it states that ARFoundation "On device Remoting (Preview)" will be launched under 2020.1.

    This will mean a whole lot more of waiting... for a preview. Or am I seeing this wrong and this is another sort of Remoting?
     
    PTW_AR and DrSharky like this.
  27. henriqueranj

    henriqueranj

    Joined:
    Feb 18, 2016
    Posts:
    141
  28. hawken

    hawken

    Joined:
    Aug 22, 2013
    Posts:
    480
    most of us don't need a complete and amazing solution... just something dirty we can test with...
     
    henriqueranj likes this.