Resolved ARKit support for iOS via Unity-ARKit-Plugin

Anyone test playback, CPU usage of video using HEVC-H.265 vs older H.264? I'm a total noob when it come to the Profiler but informal tests how slightly better performance (less CPU usage) using HEVC-H.265 on the iPhone.
I know the primary advantage of HEVC is much smaller file sizes but am more concerned with reducing CPU overhead. Would appreciate any feedback. YMMV.

 

Question about flickering materials. In a recent project I have some materials that momentarily flicker to transparent.
Usually near the top of the frame when playing back. Noticed in the attached image that the ceiling is transparent.
Also viewable here around the 45 second mark

Anyone know what causes this and how I can fix? I am guessing some setting in my LWRP material shader or texture import?

Tried adding Offset -1,-1 in the Pass section of my shader but no difference.

 

Any idea how much area(like sq.feet) does ARWorldMap support?

 

Alright dudes? Seems like I worked on another car app

This is for location scouting, they have 8 generic cars. I was able to use reflection probes from arkit which was sweet. Theres a few lighting / reflection options here.

Theres also some clearcoat paint effect here, which took ages to figure out. In the end I did two materials passes.

As always, my focus was to push the realism angle as far as it can go within the project scope and provide a simple way for users to get the results they need.

http://www.planetprepro.com/AR/guide.html

Once again many thanks to @jimmya and the arkit team at unity!

 

What happens if the ARworld map (.worldmap) is having huge size.When I hit save it gets saved Immediately or will it take time?Can we show the progress?

 

Hello everyone,

I'm getting familiar with the ARKit plugin in Unity and going through some of the initial material.
The problem I have is that whenever I build the project to test in my device, the camera renders a divided view.

The next image is a full screenshot.




I've never had this result before using AR cameras with Vuforia and more recently AR Foundation.

How can I correct this view to get a full normal screen?

Thank you

 

Omigod! This is kick-ass! Thanks for sharing!

 

what device is this? also, you should probably try out ARFoundation if you have not yet (https://docs.unity3d.com/Packages/com.unity.xr.arfoundation@1.0/manual/index.html)

 

How do you switch to front facing camera for ARKitRemote face tracking?

 

Yes, I can provide you with my fix if its any help!
I ll dm you my email

 

create a script, write this:

{
public void SceneButton(string sceneName)
{
SceneManager.LoadSceneAsync(sceneName LoadSceneMode.Single);
}

}

add it to a Parent then create a button under that parent. Use it on the OnClick event.

for further explanation, contact me.

 

This

What I've done is what I tried (poorly, tbh) to explain in that medium article. Plus, the script I have to change scenes uses the Single Load scene mode, as follows..

SceneManager.LoadSceneAsync(sceneNum, LoadSceneMode.Single);

 

Hello @jimmya ,
i want to add image trackers runtime. images would be either downloaded from network before application starts.
Usage would be generate ArReferenceImage and ArReferenceImageset runtime and supply it ARCameraManager.

I have been following this from repo and haven't been able to figure out. Let me know if there is any way to make it work from unity or combined with native code.
Any help would be appreciated.

 

Could anyone make ARKIT remote work without errors? At the moment, I cannot even connect my Unity 2019.1 Editor to iPhone via Unity Remote. I followed Unity blog post tutorial, but Editor console cannot connect to iPhone anymore!

 

2019 is currently in early TECH stage, some stuff doesn't work. Remote works in 2018.3

 

Where is the latest version of the ARKit plugin + samples?
With the ARKit XR PLugin from the package manager, i can't find any examples.
The Asset store package is deprecated
By googling, I land at the good old bitbucket but the latest commit is from 2018, so I'm not sure if that's up to date?

@jimmya Is there a fixed place with the latest info on the plugin? Or maybe the first post in this thread could be that central place?

 

Doubt on ARworldMap....https://forum.unity.com/threads/how-to-load-two-or-more-arworld-map-on-a-single-tracking.681994/

 

ARKit 3 support?

 

It's very quiet here considering the Apple ARkit3 news...?

 

ARKit plugin was officially depreciated!

ARKit 3 stuff will come to ARFoundation.

 

Is this official news from Unity? Do we have an ETA for the ARKit 3 integration?

 

Yes (although it's not very clearly communicated): https://bitbucket.org/Unity-Technologies/unity-arkit-plugin/src/default/ see bottom of this page

EDIT: Yes! Unity on ARKit3: https://blogs.unity3d.com/2019/06/06/ar-foundation-support-for-arkit-3/

 

Now, with ARKit 3, at 60fps, can ARKit + Google Cardboard be used together to achieve good 6dof VR ?

 

Is this still usable with ARFoundation? Or is there a new way to fully reset anchors on iOS? What I'm seeing is that using ARSession.Reset() seems to retain scanned data on iOS but clears as it should on Android. Thanks in advance!

 

So the eye tracking is not in ARFoundation to get position and rotation. all it gives us is which direction the user is looking at. So, my question is, are you going to bring back the eye tracking in coming future? and also while it is great that we have access to general facial expression in "ARKitBlendShapeVisualizer.cs" file. it could be great for us to access the landmarks too. IOS has vision library that can give you the landmarks. and its very fast and cheap in processing(in A11 and A12 CPUs). it would be nice if you guys combine it with ARKit in unity since we are not able to do that because camera is being used in your code. Thank you for your hard works.

 

Alright folks? Looks like I dun gone and made another AR App! This time it's for location scouting with models.

The people in these first three shots are entirely AR.





The people you can load in are 3D models made from scans. Note the shadow matching in that last shot, this is real time based on your location and time of day.

This'll probably be my last app with the ARKit plugin, moving over to ARfoundation now...

Once again many thanks to @jimmya and the arkit team at unity!

 

i'm new to Unity, i'm having the same issue. can you please help me to fix this issue.

 

where the src! This would be sick on Placenote. You can save the objs for it to be reloaded in the same spot through point cloud maps.

 

Nice work. Would love to see how you build the ui and placement and movement features. This somethign you open to sharing privately (and won't disclose) or on github because would love to see how did to help learning)?

 

@jimmya I am a newie to Unity. My requirement is UI placard image with 50% alpha used as a tracking image, when lined up with respective real world object (placard) ,the 3D model have to spawn on the coordinates.Please advise whether we have such this option in arkit. I have attached the 50% alpha image and it's corresponding real world object for your reference. Look forward to hearing from you.

 

I get compiler errors every time I download the ArKit Package. It basically gives me errors in the scripts of eye tracking even though I don’t need that script. But since it’s in the package it must be fixed.

 

Hi,

Thank you for your post!
I am doing an AR application project using LEDs.
Does someone know if a light (like an LED) can also be a target for augmented reality?

 

It should be possible, I guess?
Maybe building upon/updating https://github.com/andrewnakas/ARKit-Cardboard-VR work in this area.

 

Hi guys, I'm testing ARKit on my iphone XS max and I'm having a 1 meter drift for about every 10 meter distance from my initial location. I wanted to ask if you have tested iPhone 11 and if you have experienced less drift issues with it, and if so how much it has improved? Thanks

 

Hi I would like to use the iPhone X/11 Pro's wide angle camera for AR. Is that possible?

 

Do you mean that you would like to use it for rendering the background? If that is the case then the answer is "no". The ARKit API does not allow this. But it is likely that ARKit is using that wide-angle camera to improve its world tracking capabilities.

-Mike

 

actually we're only interested in generating a mesh from the environment (using 6D.ai), and were hoping that we could map more quicker by using the wide-angle lens.

 

Is there support coming soon for ARKit 3.5's mesh reconstruction? I have the new iPad Pro with its LIDAR sensor, and my app would greatly be improved by this feature.

 

https://forum.unity.com/threads/arkit-3-5.855262/

But yeah, in the old days (before ARFoundation), I think ARKit features were immediately available. Nowadays it takes a long time before they are available in Unity? Or am I wrong?

 

Does Unity need Alpha/Best Testers of ARKit 3.5's 2020 iPad Pro's meshing????? Let us know.

 

Suggestion: put that ARKit 3.5 message in this (the ARKit) board. I looked here to see about support status, and posted about it because I didn't expect an ARKit-specific status update to be in the general Handheld AR board.

Is it known if support for this will be added in Unity 2019.3, or put off for 2020.x, or a separate package update outside of official releases? If it's 2020.x or package update I can stop checking release notes every new release of 2019.3 to see if the new version is worth updating to. You're right that multiplatform support is needed, as spatial reconstruction has already been available for years on HoloLens, Magic Leap and ZED/ZED Mini, and more recently ARCore, each using their own API. Hopefully this feature has been in the process for ARFoundation for a while and is almost ready.

 

Hey thanks for the insight, this explains

 

Hi unity,

This is really amazing article for the arkit plugin, The y component of an extent is always 0 btw, no matter if it is a horizontal or vertical plane. So use the x and z component to calculate your plane's size.

 

I can not get this plugin now. Please help me!!!