AR Remoting & Simulation

Thanks for the update! Question about recorded sessions - is the idea that the raw video feed and full suite of sensor data will be recorded for playback and simulation? Would we basically be able to launch the recorded video + sensor data from editor and otherwise interact with the app via UI or other events normally?

 

Thanks for the update. Not sure how far you guys are but it would be great if you could push out a preview as soon as possible. The recording feature is nice but a working preview of just the remoting (incl. raycasts) would already help tremendously.

 

Agree.

 

I basically just want to see changes happening in the editors hierarchy and to check variables in the inspector. Would help a lot to understand how AR Foundation works.

 

watching this.

 

Looking forward to it too. Thanks mfuad for the update!

 

Awesome that you guys are working on a solution. I’m really looking forward to the in-editor simulation of AR features as I can see this being useful for my projects.

Is there any information you can give us about expected timeframes?

 

@BuoDev this may interest you, Satwant Singh published this video just a few days ago:

 

@vincentfretin Thanks for the video. Those are some really helpful assets. The creator of the Runtime Inspector asset has some really useful Unity tools (including an in game console tool) his GitHub page is worth a visit for sure

https://github.com/yasirkula

 

Hi! Thanks for the update, this was much needed.

Although I greatly disagree with the approach. We know that when you announce to be willing to be more transparent but don't give any estimated release date, it's most likely because the development didn't start yet.
I have the feeling this feature is passed beyond due by now, and is a good candidate for the new "nested prefab" type of feature, where everyone says it's gonna be soon but it takes years.

Now there's an opportunity to change that, please release a WIP as soon, that will work for few people, help them out, then expend the support one by one instead of adding all the features at beforehand.
Helping 10 people is still better than not helping.
We want a preview package. We want a pre-alpha, a early access, whatever. Anything will be better than nothing, to solve your transparency problem.

 

Hello ! I'm also starting to play around with AR and not having this feature is a real bummer for newcomers. Please keep us informed of the current state of this solution .

 

8th Wall have had AR Remote for more than a year...

 

Any news on this project @mfuad ?
Is it possible to be part of a pre-alpha of AR Foundation Remote?

 

I'm new to AR and really surprised this isn't already a thing. The remote tool shown here

is one the way or the one that doesn't work anymore? Must be a real pain to make a non trivial AR app without these kind of tools? Or is everyone just using another solution like 8th wall?

 

No updates...
I understand that the original post says it's a large feature and will take time. I get that the big new updates to AR Foundation might make it more difficult, and that it's a help for them to implement this in the first place.

Making the thread, and then not posting any updates in over a month though. Why make the thread in the first place?

 

They wanted to be more transparent, but they've gone completely invisible

 

Has anyone here attempted to create a remote app for AR Foundation? I'm curious to see if it'd be relatively straightforward port given that we have access to the ARKit Remote source.

 

Hi @mfuad
can you please release even alpha for this because i'd really help us save time?
Dev AR atm with unity is painful :/

 

+1

 

+1

 

To those who wonder why the community hasn't done anything about this, it's simple : closed sources. Considering Unity's build iteration time, ARFoundation is basically unusable as it is for any AR project that goes a bit beyond a table top game. I'm stuck with it atm, but I really regret upgrading from the ARKit plugin.

 

It seems like things have got a lot harder with AR since I was last using it over a year ago
It's pretty frustrating to watch the keynote where they are happily making AR projects with the greatest of ease. Cut to the real world and it's nothing like that.

 

I remember seeing a Unity video with remoting a long time ago, and now that I'm building my first AR app, I was like really? Not available yet?

+1

 

Guys i think we're hosed until MARS
Based upon the keynote and follow up - https://blogs.unity3d.com/2019/09/2...-time-3d-unite-copenhagen-keynote-highlights/

So perhaps @mfuad i should be asking for the MARS Alpha?

 

In the Unity Roadmap @ Unite Copenhagen 2019 slides (https://on.unity.com/Unite2019RoadmapTalk), in page 62, it states that ARFoundation "On device Remoting (Preview)" will be launched under 2020.1.

This will mean a whole lot more of waiting... for a preview. Or am I seeing this wrong and this is another sort of Remoting?

 

Hopefully sooner, Dan Miller on his Twitter stated AR Remote will come out later this year: https://twitter.com/DanMillerDev/status/1179209715680567296

 

most of us don't need a complete and amazing solution... just something dirty we can test with...

 

+1 @hawken

 

+1 @Tarrag

 

i just found this https://github.com/asus4/ARKitStreamer
has anybody already tried it? sounds cool (and updated a few days a ago)

 

Hi @StefanoCecere i'm author of ARKitStreamer. adding some subsystems for UnityEditor includes depth and face. the latency is not bad when using the USB network.

https://mobile.twitter.com/asus4/status/1184616712894849025

 

Hi @mfuad , Can you share any progress on the AR Foundation remote tool? Maybe an estimated time until release of the Alpha version?

 

thank you @asus4 i'm trying your package tomorrow... very happy to see you here

 

@ASUSasus1234 I tried adding the info to the manifest.json file ( Unity 2019.2.11f1 ), it's giving the following error.



Here's where I pasted the code, I also put it in different locations, but the error about 12:3 above stayed the same.
When I replaced "https://github.com/asus4/ARKitStreamer.git#upm" with "1.0.0" as a test, the error above went away but I got a message saying that it couldn't find that version of the package.

Code (JavaScript):

1. {
2.   "scopedRegistries": [
3.     {
4.       "name": "Keijiro",
5.       "url": "https://registry.npmjs.com",
6.       "scopes": ["jp.keijiro"]
7.     }
8.   ],
9.   "dependencies": {
10.     "jp.keijiro.klak.ndi": "0.2.3",
11.     "com.koki-ibukuro.arkitstream": "https://github.com/asus4/ARKitStreamer.git#upm",
12.     "com.unity.2d.sprite": "1.0.0",
13.     "com.unity.2d.tilemap": "1.0.0",

 

@Mal_Duffin thanks for testing, fixed that error.

 

Remote doesn't work with ARFoundation 3.0

 

Bumping. Is there any progress on this? Developing with ARfoundation is a pain with the constant building...

 

another year trundles by with no simple standalone remoting tool...

 

the building is not the issue - not seeing the scene is the pain!

 

I decide to move on AR core SDK.

 

Too bad you're leaving behind the paying iOS demographic.

 

Hello! Can It be used with iPhone 8 without the Depth and Face features?

 

Man, its unbelievable that after having the feature in 2017, and the ability to quickly iterate in editor, that now close to 3 yrs after killing it there is STILL no in editor testing.

Guys, its a camera, that raycasts towards planes. How freaking hard can it be to map a camera to some RTS style controls, and allow us to spawn debug planes at 0,0,0?? That solves the 90% use case, unblocks developers, and actually makes it feasible to create AR apps in unity.

I get that theres lots of advanced features you want to support, but for the love of god, please DO FIRST THINGS FIRST. Get the core AR functionality of planes/camera/raycast features (that have existed for 5 years)working in editor, before you add a single new feature. Enough is enough, this is insanity.

You guys really need to do a better job of eating your own dog food here. If you assigned a team, to make a production AR game, they would've come back after 2 weeks, and explained how ridiculously inefficient it is to build to device each time. That really should've happened in 2017.

It feels more like you guys are developing this for yourselves, as a fun technical experiment, than actually giving a S*** about the developers and whether we can actually use this thing to make a living. 3 YEARS!!?!

 

I'm just gonna go ahead and assume the team assigned to AR developments in Unity is way too small for their workload. I'm aware they're already working with Google to support the new depth API announced for AR Core and then there's DOTS support as well as Tiny support as well as HoloLens and LeapMotion support for AR foundation, all of which I think would be a higher priority than remoting because Unity's biggest strength is being first to market with features like these.

They must really have their hands full because it doesn't seem like other teams in Unity have this much of a diverse workload on.

 

Remoting is the last thing I'm waiting for doing a deep dive inside of AR Foundation. But this wait is making me sad. No one deservers an every-time compile to see the changes.

 

+1 this build times makes AR Projects much more costly for everyone! if you want for AR to expand this is critical!

give us alpha/beta package at least! for most people simple plane finding/raycasting will be enough

 

please ;(

 

main issue in delays is likely the team dissolving and being rebuilt, quite a few of the main contributors to the AR libs coming out of Unity that I know have all left in the last year..

Couldn't agree more with the notion of just ship a basic thing to start with, stop trying to build GTA IX in such a fast moving industry