Resolved ARKit support for iOS via Unity-ARKit-Plugin

Has anyone done an implementation of the FocusSquare from the "Placing Objects" demo Apple did, and willing to open source it?

 

I upgraded the version today (1.0.5, I downloaded it from the Asset Store) and I am getting weird error that says: Screen position is out of the view frustum. And also the main camera rotated 90 degrees in the y axis and z axis automatically.... and the worst part is that the camera is rendering nothing (its just green), just the canvas.

I removed everything and installed the previous package of ARKit ( I download 1 month ago from this post, I think it is the 1.0.2 version) and works well... but I am having issues with Xcode9 beta1

Anyone with these errors with the new version??

using 5.6.1p2 Unity.

 

thanks x 1000000

 

How to enable Plane Detection in ARKit ? My plane is just in the center of the camera view. Thanks

 

What is the best way to stop the ARKit Camera? Calling UnityARSessionNativeInterface.GetARSessionNativeInterface ().Pause (); and then deleting the components does not seems to work, always causes my application to crash.

More specifically:

Code (CSharp):

1. NullReferenceException: GetRef
2.   at UnityEngine.XR.iOS.UnityARVideo.OnDestroy () [0x00000] in <filename unknown>:0

It's not a huge problem for now as i can just keep the ARKit camera turned on in the background, but in the interest of optimization i would like to be able to turn on/off the camera at will.

 

Specifically i am deleting a prefab containing the ARCameraManager and CameraParent as found in the examples.

I really like the ARKit integration and despite having a few issue here and there, i cannot wait to show off what i have been building with it

 

Would be nice to make a single folder and drop the entire project in then would be super easy to everyones to import in any of out project (even the package is actually entire project...).

That my first feedback... now will start...
Cheers

 

Thanks Christopher, that would be an awesome solution!
Good luck, i’ll keep an eye out.
Also give me a yell if there’s anything I can help out with, I’d be more than happy.

 

Thank you for your response, guess it's gonna be complicated hehe.

 

Cool! Any idea how to integrate it with Unity ? )

 

Unity remote works a charm, but I have this message "Failed to connect to Player" and scene is green.
(Unity 2017.1.0b5)

Also checked out the iphone 6 wifi's settings to get the Ip adress and it fails after 3 attempts.
(iOS 11.0 beta)

Any idea?...


EDIT :

Oh nooooo..... iphone 6 doesn't support it T__T....

>>> http://appleinsider.com/articles/17...compatibility-to-iphone-6s-ipad-pro-and-newer

 

This just released. I believe its a big enough deal to post.

Another great example project for you @jimmya

https://github.com/ProjectDent/ARKit-CoreLocation

 

Hi @jimmya, any update on this?

 

Hi Chris,

That's great, but has this been implemented in the asset store version? I must not be finding an accessible implementation in UnityARSessionNativeInterface.cs

Alfred

 

What is the link for this update?

 

Hey all,

I looked back through this thread on collision issues with the collisionPlanePrefab, but there was only one instance where someone had the same issue as I do. The response was to reread the manual on colliders and rigidbody. However, I believe the problem is deeper than that:

GeneratePlanes creates the prefabs but seem to lack the collider component.
If I instantiate the same prefab with a button, it's fine: my falling objects collide without an issue.

Can anyone confirm that they have the same issue? My attempts at using the ARKit remote to check the instantiated prefab planes didn't work so well since there is incredible lag.

 

Thanks for verifying Chris. Yes, they're all there as noted, and yes I noticed the additional collider.
I'll keep debugging, I appreciate the confirmation and your time!

 

I had some luck with the world scaling issue by having the AR Camera under a parent and then scaling that parent instead, tracking worked fine, and now I can change world scale dynamically on the fly by scaling the AR camera parent instead of scaling the entire scene (the scene is located at position 0,0,0 and has too many meshes, static objects, complex particle effects etc). I also was able to position the camera parent when doing hit testing instead of moving the scene objects (so the user can tap on the surface in front of him and have the scene framed in view correctly). I'm still having some weird issue with quaternions, though. Currently when doing the hit testing I move the camera parent with the following logic:

Code (CSharp):

1.                 m_HitTransform.position = UnityARMatrixOps.GetPosition (hitResult.worldTransform);
2.                 m_HitTransform.rotation = UnityARMatrixOps.GetRotation (hitResult.worldTransform);
3.  
4.                 ARSystem.instance.ARCamRoot.transform.position = -m_HitTransform.position * ARSystem.instance.ARCamRoot.transform.localScale.x;
5.                 ARSystem.instance.ARCamRoot.transform.rotation = Quaternion.Inverse (m_HitTransform.rotation);
6.  

Anyone has a better approach would? Suggestions?

 

Thanks! I suspected tracked data would also need to be scaled accordingly. But I think the effort to incorporate world scaling in Unity ARKit plugin would be worth it. Then we could incorporate complex scenes without having to worry about moving/scaling each single scene element to frame the scene and instead only scale and move the camera parent in relation to the scene which should make development for complex scenes easier.

 

Ok. I attached a test unity project with the basic world scaling + camera based framing for anyone who wants to toy with it, two main advantages (ARKit tracking data rendering is missing though):

- When framing the scene, I'm moving the camera parent instead of moving the AR scene objects. This allows for better handling of complex scenes that have a lot static objects that can't be moved in play time, particle effects etc...For that I'm using reverse Quaternions and subtracting the scene object's root position (which is vector3.zero) from the hitTest position and then multiplying that by the camera root scaling (See ARManager script lines 38 and 39):

Code (CSharp):

1.                 m_HitTransform.position = UnityARMatrixOps.GetPosition (hitResult.worldTransform);
2.                 m_HitTransform.rotation = UnityARMatrixOps.GetRotation (hitResult.worldTransform);
3.  
4.                 CameraParent.transform.localPosition = 0 - m_HitTransform.position * WorldScaleSlider.value;
5.                 CameraParent.transform.localRotation = Quaternion.Inverse (m_HitTransform.rotation);
6.  

- You can change world scaling on the fly by moving the slider (and that simply scales the camera parent), you will need to tap the screen again to do another hit test with the new "world" scaling for the cube to appear again.

Scene name is "ARKitWorldScaling"

 

Hey guys so I tried building and running this project on unity to Xcode(https://github.com/MatthewHallberg/ARkitMinecraft) and it was successful. However once I launched the application on my iPhone 7 it crashes and closes. Afterwards I got these in the console in Unity...

Anyone know whats wrong with the project maybe or something I've done wrong/ not setup?? Any help will be greatly appreciated!

p.s My setup is all updated -> iOS 11 beta 4, Xcode 9 beta 3, Unity 2017.1
Thanks

 

Ok this is pretty much all I get on Xcode (I just built and ran it again, getting the usual thing(I know its generic iOS device, dw I know how to build arkit projects lol))

 

Ok no problem I just made a new project. P.s it wasn't the generic Device thing I just took a screenshot with that set and couldn't be bothered to take another screenshot. But again Thanks for the quick response! Also I really would want to see the CoreML implementation in Unity, that would be awesome! Keep up the great work over at Unity!

 

Anyone having luck getting MobileARShadow shader to work? It's showing as a solid white plane for me.

Edit: it is actually working fine on device, it is just glitchy in the editor. Works great!

 

Having the following error importing the AR Kit asset from store :

Unity 2017.1.0b5

 

Finally fixed from code the 2 errors to the top, made a straight build and working a charm on iphone 7!

Any possibility to drop every files from the Unity AR Kit plugin file into a single "_UnityARKit" folder to the next update?
Would be super convenient to use this plugin into an existing project ^_^!...

 

Have same problem with Unity 2017.1.0f3, AR Kit 1.0.5 and iPhone 7 Plus via cable.
Any ideas to solve this?

 

@christophergoy I'm trying to fine tune with with stereoscopic view, also posted here a while back. I believe mixed reality is possible with ARkit now (even if it has a little tracking issue when on a headset). Can you suggest a better way to add Stereo to current ARkit projects? I tried GVR plugin and it works but I'm looking for a solution that works on the camera level rather than rendering the main camera to a quad and displaying it with GVR camera. I also tried the Viewport mod on the main camera by adding two more cameras, the problem is one eye (camera) shows the ARTexture and other shows the virtual world. Is it possible to make this work or am I asking too much for now? Any input from your side would be very valuable for me.