Resolved ARKit support for iOS via Unity-ARKit-Plugin

I am trying to get the RGB background image ( from the YUV material) on a texture of better on a Color32[] , i have being trying even modifying the shader to make it create an additional texture with the RGB info ... because i can't use readPixels on the mat, and i can't use readpixels on the y Material and the CbCr Material, as they are R8 and RG16 any idea how to obtain the image (in RGB or YCBCR) in a Color32[]?

 

ANY solution there?

 

I tried to build the Unity sameple scenefor IOs11 on Iphone 7s , with beta 5 , with Xcode 9 beta and Unity 2017.
THe app keeps crashing on starting.

 

Just updated an iPhone 7 to iOS 11 beta, rebuilt my current project with Unity 2017.1.0f3, ARKit Plugin 1.0.7 and Xcode 9 beta 5, everything is working as on beta 5

 

Heyo guys!

Curious on what everyone's approaches are on table edge detection! For instance in the Wingnut AR demo (Unreal Engine yeah), it seems to detect the edges of the table since people are falling off the table!

 

Hello, where should I report bug about ARKit plugin ?

I have downloaded XCode Beta 5 and UnityARKitPlugin from the asset store and on two different computers (MacBookPro & MacMini) I got the same error without adding anything else.

 

This is just the standard plane detection that ARKit provides. Looking at the video (multiple times) I can see some of the experience must have been canned for the demo. The tracking of that table is near perfect and it gets it size so quick. Anyways, the plugin will return the plane it has found and then you can use that as a collider. When objects reach the edge, they naturally fall off.

 

Huh! I've been playing around with the plane generator prefab but it sometimes causes overflowing on the edges. I wonder how they solved it! Or if the demo even had that "live".

 

Apologies if this has already been covered in the thread, but I'm finding that the performance of plane detection using ARKitRemote with the editor is almost unusable. Planes sometimes pop in and out in one frame and otherwise rarely show up in what are very good tracking conditions.

When I make a build of the same code and put it on a device, the plane detection works rather nicely as I would expect. This makes it a bit difficult to work out bits that make use of the plane detection. I've spoken to another dev who has had the same experience. Does anyone who has had the same experience know a way around it?

 

I can confirm the fix. Everything stable in beta 5.

 

Can confirm that was 100% live

 

@christophergoy
Hi,

Any news concerning the scale issue previously mentioned about the Navigation Mesh?
Having a presentation on 20th for an rts game I wrote using the ARKit but really if the navmesh isn't working it is useless feature yet ....

Would be super helpful,

Thank you by advance!

 

I'll be there!!

 

I'm getting the same error.
Unity 5.6.2p4, Xcode 9 beta 5, iOS 11 beta 5, OSX 10.12.6

 

I updated iOS to 11 beta 6 and it works now!!

 

The camerastream with ARKit in Unity (perhaps also without Unity), is of a lower resolution than then the actual camera in the phone/tablet. Is there any way to have the full videoresolution (I believe this would be 1080p)?
Also it seems that the camera doesn't do autofocus? Stuff in the distance is always a bit unsharp I think (I hope I can hotlink to twitter):



This is ARKit in Unity with a daylight system based on time, date, GPS and compass =) Gives cool results I think
- Any way to improve the size estimation? Maybe there is a way to tell arkit to "scan" the scene for a longer time? The car sometimes appears about 20% larger thatn it is hehe

 

Im using a project that uses both Vuforia and ARKit.
When I switch between the two, and try and start ARKit, I get 'Unsupported pixel format: 875704438', which prevents the ARKit from starting up correctly - and I'm presented with a frozen video image, with no tracking.


Xcode Error Log;

017-08-15 19:48:52.356520+0100 MY_APP[512:113836] [Sensor] Unsupported pixel format: 875704438

2017-08-15 19:48:52.357276+0100 MY_APP[512:113836] [Session] Session did fail with error: Error Domain=com.apple.arkit.error Code=104 "Unsupported capture session configuration." UserInfo={

NSLocalizedRecoverySuggestion=Make sure that the correct device and format are being used for capture.,

NSLocalizedDescription=Unsupported capture session configuration.,

NSLocalizedFailureReason=Input device and/or format of the provided capture session are not supported for the given configuration.}

It's extremely vital that I get ARKit working after Vuforia has been used. Does anyone have an idea how I can fix this? I have a feeling Vuforia is changing the Camera Device formatting, and that's being cached somewhere; thus when ARKit boots up, it ends up using the cached values. That is just a complete guess, I don't actually know.

I would appreciate any help in the matter. Thanks

PS. This worked fine on Beta-2, but not on any recent Betas after 2.
PPS. When switching from Vuforia to ARKit; it works. Then when switching BACK to Vuforia, and then back to ARKit; it fails.

 

That looks amazing, great work. I would be interested to know which packages you used to achieve the final result.

As for Auto-Focus, I dont think this is going to be supported any time soon. ARKit uses a fixed focus system so that the camera matrix calculations stay correct. If the focus had to change then the calculations would constantly have to be updated, resulting in performance issues. This is my understanding, I could be wrong though

 

Yeah, makes sense. They managed to line up the content on that table pretty well, probably due to the height of the table vs the backdrop and the floor, they could determine its location easier. It was an impressive demo. Do you have a link to the video on this at SIGGRAPH?

 

pretty sure you can't build to a generic device... you need to select your actual device!

 

looks awesome, great effort! That the standard shader or something else?

 

Thanks, I mostly used standard components (direct light, unity skybox and standard shader) + a script to set the position of the direct light. But right now (not shown in the photo) I have found a way to combine unity's skybox with a reflection map, best of both worlds.
Pity about the auto focus, hope they will find a way to include it for scenes that are larger than table top (like a car on 1:1 scale)

 

Can I adjust camera resolution?

 

Hi
Which elements i can't destroy when swaping scenes from arkit scene to something without it? I'm asking cuz in my current project have problem when swaping from scene using ARKit plugin to scene without, it only happens when testing app on my device.

 

Out of curiosity! What's everyones experience with vertical planar tracking? Reading the second paragraph on https://developer.apple.com/arkit/ , they only mention horizontal surfaces. But what if i wanted to preview artwork on my walls?

 

not possible (yet). Some other frameworks allow for it I think (saw a video here earlier), but the tracking is less good than ARKit.

 

Does that mean that it will be included?

 

Is there any way to always force the correct format every time ARKit Starts?
Thanks.

-- update --

I find it weird that if I use Vuforia first, and then ARKit after; it works just fine. Only fails when I switch back to Vuforia, and then back to ARKit. :/

 

@christophergoy
That looks great!
A bit late in Japan now....
We’ll be on it once to the office tomorrow for sure!
Thank you so much!! ^_^

 

I read (past tense) about 7 pages on this forum but there are 23 so forgive me if this has been asked before. How do I get real world scale data into Unity from ARK kit. Like if I wanted to know the real world distance between 2 points. Like in this ruler demo.

 

Its already supported out of the box. 1 unit in Unity is 1 metre in reality. So you just need to use something like Vector3.Distance to calculate the distance between two Vectors inside your scene and you should have your solution!

 

Amazing work! Thanks for doing this. This question popped up for our game recently and it was quickly dismissed, but I think we will revisit the idea now

 

That is awesome. Thank you.

 

Update about errors.

Software: Unity 5.6.2p4, XCode beta5, ARKit plugin from Asset Store.
Error when launching the app after XCode compilation.

Here is the log:
2017-08-16 17:57:24.960792+0200 arkitscene[322:40831] *** Terminating app due to uncaught exception 'NSInvalidArgumentException', reason: '-[ARFrame displayTransformWithViewportSizerientation:]: unrecognized selector sent to instance 0x1c02ef780'

*** First throw call stack:

(0x185a3bd38 0x184f50528 0x185a491f8 0x185a416e4 0x1859270dc 0x10049d734 0x19fe42ff8 0x1853c0fec 0x1853c0fac 0x1853cdad8 0x1859e3f20 0x1859e1afc 0x1859022d8 0x187788f84 0x18ee34c90 0x100123040 0x18542656c)

libc++abi.dylib: terminating with uncaught exception of type NSException

(lldb)

The problem is probably easy, but I have really low understanding of the ARKit library. Does anyone have encountered this error ?

 

I've created a session using

Code (CSharp):

1. m_session = UnityARSessionNativeInterface.GetARSessionNativeInterface();

We want to give players the option of turning AR off; is this enough?

Code (CSharp):

1. m_session = null;

Or is there an equivalent Destroy() method for a UnityARSessionNativeInterface?

 

Hello,

The plugin works great but I just updated it and now I'm getting the following error in XCODE when I'm trying to build, I'm not sure why? Nothing changed except I updated ARkit plugin.
IMAGE ATTACHED

www.christophermanzione.com/wp-content/uploads/2017/08/xcodeerror.png