ARKitRemote & iPhone Camera

Hello,
I'm using unity (newest version) and an iPhone 7 via usb on macbook.

I build and run the ARKitRemote on my iPhone and it is waiting for connection. Then I play a scene like UnityARKitScene or FocusSquare in Unity and connect my device via console. I get my camera picture in Unity but my iPhone only shows "waiting for connection" instead the camera picture. I thought that camera picture is shown in unity and on my device. But not on mine. Why is that ? Anyone have got the same problem ?

Thanks for your help.

 

I've got the same problem. Posted on the main forum, but got no answer yet.

 

I've just given ARKitRemote a try today as well, and following the instructions included in the readme file I was able to have the remote scene built and deployed on an iPhone 6s plus, but after running the scene and establishing the connection in the editor, the video from the phone appears on the unity editor window on my MacBook, yet shows either a 'Waiting for editor connection' message, or just a black screen with the words 'Development Build' at the bottom left of the phone screen. Moving the phone around accurately updates the image on the editor window in unity, displaying what the phone is pointed at, but the phone screen does not show what it is pointing at

I have restarted both the phone and MacBook and tried again, with the same results.
I have redeployed the built remote scene, no change in results.

This was the Xcode log:
----
2017-11-30 22:06:06.502038+0000 arkitsceneremote[314:17441] [DYMTLInitPlatform] platform initialization successful
2017-11-30 22:06:06.600786+0000 arkitsceneremote[314:17264] -> registered mono modules 0x1057235c0
-> applicationDidFinishLaunching()
PlayerConnection initialized from /var/containers/Bundle/Application/D89EAC78-3CD3-4991-A765-CA49F20CB04C/arkitsceneremote.app/Data (debug = 0)
PlayerConnection initialized network socket : 0.0.0.0 55000
Multi-casting "[IP] 100.84.56.166 [Port] 55000 [Flags] 2 [Guid] 2692687791 [EditorId] 349525411 [Version] 1048832 [Id] iPhonePlayer(Matthews-iPhone):56000 [Debug] 0" to [225.0.0.222:54997]...
Started listening to [0.0.0.0:55000]
2017-11-30 22:06:06.758198+0000 arkitsceneremote[314:17264] Metal GPU Frame Capture Enabled
2017-11-30 22:06:06.758819+0000 arkitsceneremote[314:17264] Metal API Validation Disabled
2017-11-30 22:06:06.849829+0000 arkitsceneremote[314:17264] [MC] Lazy loading NSBundle MobileCoreServices.framework
2017-11-30 22:06:06.850896+0000 arkitsceneremote[314:17264] [MC] Loaded MobileCoreServices.framework
2017-11-30 22:06:06.855073+0000 arkitsceneremote[314:17264] [MC] System group container for systemgroup.com.apple.configurationprofiles path is /private/var/containers/Shared/SystemGroup/systemgroup.com.apple.configurationprofiles
2017-11-30 22:06:06.873833+0000 arkitsceneremote[314:17264] refreshPreferences: HangTracerEnabled: 0
2017-11-30 22:06:06.873886+0000 arkitsceneremote[314:17264] refreshPreferences: HangTracerDuration: 500
2017-11-30 22:06:06.873911+0000 arkitsceneremote[314:17264] refreshPreferences: ActivationLoggingEnabled: 0 ActivationLoggingTaskedOffByDA:0
-> applicationDidBecomeActive()
GfxDevice: creating device client; threaded=1
Initializing Metal device caps: Apple A9 GPU
Initialize engine version: 2017.3.0b11 (8e840c60cd77)
WARNING: Shader Unsupported: 'Hidden/BlitToDepth' - Pass '' has no vertex shader
WARNING: Shader Unsupported: 'Hidden/BlitToDepth' - Setting to default shader.
WARNING: Shader Unsupported: 'Hidden/BlitToDepth_MSAA' - Pass '' has no vertex shader
WARNING: Shader Unsupported: 'Hidden/BlitToDepth_MSAA' - Setting to default shader.
=================================================================
Main Thread Checker: UI API called on a background thread: -[UIApplication delegate]
PID: 314, TID: 17458, Thread name: (none), Queue name: NSOperationQueue 0x1c0235be0 (QOS: UNSPECIFIED), QoS: 0
Backtrace:
4 arkitsceneremote 0x00000001045503dc UnityCurrentOrientation + 60
5 arkitsceneremote 0x000000010453d8c4 __UnityCoreMotionStart_block_invoke + 108
6 Foundation 0x0000000186e89310 <redacted> + 16
7 Foundation 0x0000000186dc99e4 <redacted> + 72
8 Foundation 0x0000000186db9620 <redacted> + 848
9 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
10 libdispatch.dylib 0x0000000185e486c8 <redacted> + 288
11 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
12 libdispatch.dylib 0x0000000185e486c8 <redacted> + 288
13 libdispatch.dylib 0x0000000185e48574 <redacted> + 104
14 Foundation 0x0000000186e8afe8 <redacted> + 376
15 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
16 libdispatch.dylib 0x0000000185e493d4 <redacted> + 428
17 libdispatch.dylib 0x0000000185e47d88 <redacted> + 784
18 libdispatch.dylib 0x0000000185e4e1c8 <redacted> + 596
19 libdispatch.dylib 0x0000000185e4df10 <redacted> + 120
20 libsystem_pthread.dylib 0x00000001860e7120 _pthread_wqthread + 1268
21 libsystem_pthread.dylib 0x00000001860e6c20 start_wqthread + 4
2017-11-30 22:06:09.437633+0000 arkitsceneremote[314:17458] [reports] Main Thread Checker: UI API called on a background thread: -[UIApplication delegate]
PID: 314, TID: 17458, Thread name: (none), Queue name: NSOperationQueue 0x1c0235be0 (QOS: UNSPECIFIED), QoS: 0
Backtrace:
4 arkitsceneremote 0x00000001045503dc UnityCurrentOrientation + 60
5 arkitsceneremote 0x000000010453d8c4 __UnityCoreMotionStart_block_invoke + 108
6 Foundation 0x0000000186e89310 <redacted> + 16
7 Foundation 0x0000000186dc99e4 <redacted> + 72
8 Foundation 0x0000000186db9620 <redacted> + 848
9 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
10 libdispatch.dylib 0x0000000185e486c8 <redacted> + 288
11 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
12 libdispatch.dylib 0x0000000185e486c8 <redacted> + 288
13 libdispatch.dylib 0x0000000185e48574 <redacted> + 104
14 Foundation 0x0000000186e8afe8 <redacted> + 376
15 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
16 libdispatch.dylib 0x0000000185e493d4 <redacted> + 428
17 libdispatch.dylib 0x0000000185e47d88 <redacted> + 784
18 libdispatch.dylib 0x0000000185e4e1c8 <redacted> + 596
19 libdispatch.dylib 0x0000000185e4df10 <redacted> + 120
20 libsystem_pthread.dylib 0x00000001860e7120 _pthread_wqthread + 1268
21 libsystem_pthread.dylib 0x00000001860e6c20 start_wqthread + 4
Setting up 1 worker threads for Enlighten.
Thread -> id: 16bc9b000 -> priority: 1
UnloadTime: 2.434541 ms
STARTING ConnectToEditor
UnityEngine.XR.iOS.ConnectToEditor:Start()

(Filename: /Users/builduser/buildslave/unity/build/artifacts/generated/common/runtime/DebugBindings.gen.cpp Line: 51)


-----

While the scene was running, connected to the phone, I also observed these messages (errors?) from Xcode repeating over and over:

-----
2017-11-30 22:07:46.030125+0000 arkitsceneremote[314:17626] [MC] Reading from public effective user settings.
Can not send network message. Receiver can not keep up with the amount of data sent
UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)

[/Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp line 405]
(Filename: /Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp Line: 405)

Can not send network message. Receiver can not keep up with the amount of data sent
UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)
UnityEngine.XR.iOS.UnityRemoteVideo:OnPreRender()


Can not send network message. Receiver can not keep up with the amount of data sent
UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)
UnityEngine.XR.iOS.UnityRemoteVideo:OnPreRender()

[/Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp line 405]
(Filename: /Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp Line: 405)

Can not send network message. Receiver can not keep up with the amount of data sent
UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)
UnityEngine.XR.iOS.UnityRemoteVideo:OnPreRender()
-----

Is it a player connection issue?
Edit: I'm currently on unity 2017.3.0b11

 

#MeToo And it's 2018 now

 

For me is it working now on iPhone 7, latest Unity Version and latest arkit.

Kind regards

 

Make sure you're using the USB connection and not the WiFi connection. This works pretty well for me on all Unity versions. Also, check that your Unity profiler connection works (same player connection is used for ARKit Remote) - it may be using some ports that your Firewall does not like.

 

I have tried to build the unity ARKIT REMOTE with my iphone X. But when the app launches I can only see what my camera is pointing at for just a few seconds on the unity game window, then it freezes.
Then Xcode stops with an error saying that the receiver can't keep up with the amount of data (see below)..

Also my app is for an AR project and im using facetracking. It originally worked when I first set up the arkit remote but now it only uses the back camera and not the front one anymore.
And just to clarify, this issue adds up on top of the fact that the arkit remote freezes when I press play in unity.
Any tips to solve this issue?


ERROR FROM XCODE:

Can not send network message. Receiver can not keep up with the amount of data sent

UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)



[/Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp line 424]

(Filename: /Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp Line: 424)



testfacetracking(1224,0x1b4bf3b40) malloc: *** error for object 0x120142626: pointer being freed was not allocated

*** set a breakpoint in malloc_error_break to debug

(lldb)

 

Bump. Anyone find a solution?

 

Get latest ARKit plugin.