Search Unity

ARKitRemote & iPhone Camera

Discussion in 'ARKit' started by Deleted User, Nov 22, 2017.

  1. Deleted User

    Deleted User

    Guest

    Hello,
    I'm using unity (newest version) and an iPhone 7 via usb on macbook.

    I build and run the ARKitRemote on my iPhone and it is waiting for connection. Then I play a scene like UnityARKitScene or FocusSquare in Unity and connect my device via console. I get my camera picture in Unity but my iPhone only shows "waiting for connection" instead the camera picture. I thought that camera picture is shown in unity and on my device. But not on mine. Why is that ? Anyone have got the same problem ?

    Thanks for your help.
     
    jaehossung likes this.
  2. mikeyt0078

    mikeyt0078

    Joined:
    Nov 20, 2017
    Posts:
    8
    I've got the same problem. Posted on the main forum, but got no answer yet.
     
  3. graybel

    graybel

    Joined:
    May 11, 2013
    Posts:
    4
    I've just given ARKitRemote a try today as well, and following the instructions included in the readme file I was able to have the remote scene built and deployed on an iPhone 6s plus, but after running the scene and establishing the connection in the editor, the video from the phone appears on the unity editor window on my MacBook, yet shows either a 'Waiting for editor connection' message, or just a black screen with the words 'Development Build' at the bottom left of the phone screen. Moving the phone around accurately updates the image on the editor window in unity, displaying what the phone is pointed at, but the phone screen does not show what it is pointing at

    I have restarted both the phone and MacBook and tried again, with the same results.
    I have redeployed the built remote scene, no change in results.

    This was the Xcode log:
    ----
    2017-11-30 22:06:06.502038+0000 arkitsceneremote[314:17441] [DYMTLInitPlatform] platform initialization successful
    2017-11-30 22:06:06.600786+0000 arkitsceneremote[314:17264] -> registered mono modules 0x1057235c0
    -> applicationDidFinishLaunching()
    PlayerConnection initialized from /var/containers/Bundle/Application/D89EAC78-3CD3-4991-A765-CA49F20CB04C/arkitsceneremote.app/Data (debug = 0)
    PlayerConnection initialized network socket : 0.0.0.0 55000
    Multi-casting "[IP] 100.84.56.166 [Port] 55000 [Flags] 2 [Guid] 2692687791 [EditorId] 349525411 [Version] 1048832 [Id] iPhonePlayer(Matthews-iPhone):56000 [Debug] 0" to [225.0.0.222:54997]...
    Started listening to [0.0.0.0:55000]
    2017-11-30 22:06:06.758198+0000 arkitsceneremote[314:17264] Metal GPU Frame Capture Enabled
    2017-11-30 22:06:06.758819+0000 arkitsceneremote[314:17264] Metal API Validation Disabled
    2017-11-30 22:06:06.849829+0000 arkitsceneremote[314:17264] [MC] Lazy loading NSBundle MobileCoreServices.framework
    2017-11-30 22:06:06.850896+0000 arkitsceneremote[314:17264] [MC] Loaded MobileCoreServices.framework
    2017-11-30 22:06:06.855073+0000 arkitsceneremote[314:17264] [MC] System group container for systemgroup.com.apple.configurationprofiles path is /private/var/containers/Shared/SystemGroup/systemgroup.com.apple.configurationprofiles
    2017-11-30 22:06:06.873833+0000 arkitsceneremote[314:17264] refreshPreferences: HangTracerEnabled: 0
    2017-11-30 22:06:06.873886+0000 arkitsceneremote[314:17264] refreshPreferences: HangTracerDuration: 500
    2017-11-30 22:06:06.873911+0000 arkitsceneremote[314:17264] refreshPreferences: ActivationLoggingEnabled: 0 ActivationLoggingTaskedOffByDA:0
    -> applicationDidBecomeActive()
    GfxDevice: creating device client; threaded=1
    Initializing Metal device caps: Apple A9 GPU
    Initialize engine version: 2017.3.0b11 (8e840c60cd77)
    WARNING: Shader Unsupported: 'Hidden/BlitToDepth' - Pass '' has no vertex shader
    WARNING: Shader Unsupported: 'Hidden/BlitToDepth' - Setting to default shader.
    WARNING: Shader Unsupported: 'Hidden/BlitToDepth_MSAA' - Pass '' has no vertex shader
    WARNING: Shader Unsupported: 'Hidden/BlitToDepth_MSAA' - Setting to default shader.
    =================================================================
    Main Thread Checker: UI API called on a background thread: -[UIApplication delegate]
    PID: 314, TID: 17458, Thread name: (none), Queue name: NSOperationQueue 0x1c0235be0 (QOS: UNSPECIFIED), QoS: 0
    Backtrace:
    4 arkitsceneremote 0x00000001045503dc UnityCurrentOrientation + 60
    5 arkitsceneremote 0x000000010453d8c4 __UnityCoreMotionStart_block_invoke + 108
    6 Foundation 0x0000000186e89310 <redacted> + 16
    7 Foundation 0x0000000186dc99e4 <redacted> + 72
    8 Foundation 0x0000000186db9620 <redacted> + 848
    9 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
    10 libdispatch.dylib 0x0000000185e486c8 <redacted> + 288
    11 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
    12 libdispatch.dylib 0x0000000185e486c8 <redacted> + 288
    13 libdispatch.dylib 0x0000000185e48574 <redacted> + 104
    14 Foundation 0x0000000186e8afe8 <redacted> + 376
    15 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
    16 libdispatch.dylib 0x0000000185e493d4 <redacted> + 428
    17 libdispatch.dylib 0x0000000185e47d88 <redacted> + 784
    18 libdispatch.dylib 0x0000000185e4e1c8 <redacted> + 596
    19 libdispatch.dylib 0x0000000185e4df10 <redacted> + 120
    20 libsystem_pthread.dylib 0x00000001860e7120 _pthread_wqthread + 1268
    21 libsystem_pthread.dylib 0x00000001860e6c20 start_wqthread + 4
    2017-11-30 22:06:09.437633+0000 arkitsceneremote[314:17458] [reports] Main Thread Checker: UI API called on a background thread: -[UIApplication delegate]
    PID: 314, TID: 17458, Thread name: (none), Queue name: NSOperationQueue 0x1c0235be0 (QOS: UNSPECIFIED), QoS: 0
    Backtrace:
    4 arkitsceneremote 0x00000001045503dc UnityCurrentOrientation + 60
    5 arkitsceneremote 0x000000010453d8c4 __UnityCoreMotionStart_block_invoke + 108
    6 Foundation 0x0000000186e89310 <redacted> + 16
    7 Foundation 0x0000000186dc99e4 <redacted> + 72
    8 Foundation 0x0000000186db9620 <redacted> + 848
    9 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
    10 libdispatch.dylib 0x0000000185e486c8 <redacted> + 288
    11 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
    12 libdispatch.dylib 0x0000000185e486c8 <redacted> + 288
    13 libdispatch.dylib 0x0000000185e48574 <redacted> + 104
    14 Foundation 0x0000000186e8afe8 <redacted> + 376
    15 libdispatch.dylib 0x0000000185e41048 <redacted> + 16
    16 libdispatch.dylib 0x0000000185e493d4 <redacted> + 428
    17 libdispatch.dylib 0x0000000185e47d88 <redacted> + 784
    18 libdispatch.dylib 0x0000000185e4e1c8 <redacted> + 596
    19 libdispatch.dylib 0x0000000185e4df10 <redacted> + 120
    20 libsystem_pthread.dylib 0x00000001860e7120 _pthread_wqthread + 1268
    21 libsystem_pthread.dylib 0x00000001860e6c20 start_wqthread + 4
    Setting up 1 worker threads for Enlighten.
    Thread -> id: 16bc9b000 -> priority: 1
    UnloadTime: 2.434541 ms
    STARTING ConnectToEditor
    UnityEngine.XR.iOS.ConnectToEditor:Start()

    (Filename: /Users/builduser/buildslave/unity/build/artifacts/generated/common/runtime/DebugBindings.gen.cpp Line: 51)


    -----

    While the scene was running, connected to the phone, I also observed these messages (errors?) from Xcode repeating over and over:

    -----
    2017-11-30 22:07:46.030125+0000 arkitsceneremote[314:17626] [MC] Reading from public effective user settings.
    Can not send network message. Receiver can not keep up with the amount of data sent
    UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)

    [/Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp line 405]
    (Filename: /Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp Line: 405)

    Can not send network message. Receiver can not keep up with the amount of data sent
    UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)
    UnityEngine.XR.iOS.UnityRemoteVideo:OnPreRender()


    Can not send network message. Receiver can not keep up with the amount of data sent
    UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)
    UnityEngine.XR.iOS.UnityRemoteVideo:OnPreRender()

    [/Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp line 405]
    (Filename: /Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp Line: 405)

    Can not send network message. Receiver can not keep up with the amount of data sent
    UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)
    UnityEngine.XR.iOS.UnityRemoteVideo:OnPreRender()
    -----

    Is it a player connection issue?
    Edit: I'm currently on unity 2017.3.0b11
     
    ina likes this.
  4. SunnyChow

    SunnyChow

    Joined:
    Jun 6, 2013
    Posts:
    337
    #MeToo :( And it's 2018 now
     
  5. Deleted User

    Deleted User

    Guest

    For me is it working now on iPhone 7, latest Unity Version and latest arkit.

    Kind regards
     
    jimmya likes this.
  6. jimmya

    jimmya

    Unity Technologies

    Joined:
    Nov 15, 2016
    Posts:
    793
    Make sure you're using the USB connection and not the WiFi connection. This works pretty well for me on all Unity versions. Also, check that your Unity profiler connection works (same player connection is used for ARKit Remote) - it may be using some ports that your Firewall does not like.
     
  7. sissy_973

    sissy_973

    Joined:
    Aug 14, 2018
    Posts:
    1
    I have tried to build the unity ARKIT REMOTE with my iphone X. But when the app launches I can only see what my camera is pointing at for just a few seconds on the unity game window, then it freezes.
    Then Xcode stops with an error saying that the receiver can't keep up with the amount of data (see below)..

    Also my app is for an AR project and im using facetracking. It originally worked when I first set up the arkit remote but now it only uses the back camera and not the front one anymore.
    And just to clarify, this issue adds up on top of the fact that the arkit remote freezes when I press play in unity.
    Any tips to solve this issue?


    ERROR FROM XCODE:


    Can not send network message. Receiver can not keep up with the amount of data sent


    UnityEngine.PlayerConnectionInternal:UnityEngine.IPlayerEditorConnectionNative.SendMessage(Guid, Byte[], Int32)



    [/Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp line 424]

    (Filename: /Users/builduser/buildslave/unity/build/Runtime/Network/PlayerCommunicator/GeneralConnection.cpp Line: 424)



    testfacetracking(1224,0x1b4bf3b40) malloc: *** error for object 0x120142626: pointer being freed was not allocated

    *** set a breakpoint in malloc_error_break to debug

    (lldb)
     
  8. yezzer

    yezzer

    Joined:
    Oct 30, 2009
    Posts:
    143
    Bump. Anyone find a solution?
     
  9. jimmya

    jimmya

    Unity Technologies

    Joined:
    Nov 15, 2016
    Posts:
    793
    Get latest ARKit plugin.