Search Unity

  1. Unity 6 Preview is now available. To find out what's new, have a look at our Unity 6 Preview blog post.
    Dismiss Notice
  2. Unity is excited to announce that we will be collaborating with TheXPlace for a summer game jam from June 13 - June 19. Learn more.
    Dismiss Notice
  3. Dismiss Notice

Feature Request Be able to use USB or Ethernet cable for Live (Face) Capture

Discussion in 'Virtual Production' started by Paul-van-der-Laan, Jun 15, 2022.

  1. Paul-van-der-Laan

    Paul-van-der-Laan

    Joined:
    Oct 12, 2013
    Posts:
    60
    I can setup a Live Capture connection between my iPhone 13 and my windows pc through wifi but it's not very stable (occasional hick-ups and losing connection). Ideally I want to have the option to stream the face capture data through a reliable cable connection such as USB or Ethernet.

    With Reallusion iClone's implementation of ARKit, it's possible to use a usb connection by using the iPhone's hotspot feature, as described here: https://manual.reallusion.com/Motio...ug_in/Motion_Live/Connecting_to_LIVE_Face.htm

    I tested this and it works. However, when I do the same steps the Unity Live Capture app is not able to connect with the Unity Editor.

    Has anyone managed to use a usb connection for Unity Live Capture? If not, I want to request this feature for stable streaming.
     
  2. fffMalzbier

    fffMalzbier

    Joined:
    Jun 14, 2011
    Posts:
    3,276
    Using a Iphone Ethernet adapter should work to get your network connection reliable instad of using wifi.
     
  3. Paul-van-der-Laan

    Paul-van-der-Laan

    Joined:
    Oct 12, 2013
    Posts:
    60
    Have you tried this and can you confirm that using an Ethernet cable works with Unity Live Capture?

    I have tried connecting my iPhone 13 (Software version 15.3.1) to my windows pc using the official Apple Ethernet USB adapter and USB to Lightning adapter, but unfortunately when I connect the Ethernet adapter I get a message on the iPhone saying:

    Cannot Use Accessory
    Apple USB Ethernet Adapter: this accessory requires too much power.

    When I google this, i see recommendations for using the Apple Lightning to USB 3 Camera Adapter which can supply extra (external) power but I don't know if this adapter will allow me use Unity Live Capture through a cable.
     
  4. fffMalzbier

    fffMalzbier

    Joined:
    Jun 14, 2011
    Posts:
    3,276
    Unity Live Capture just uses the network data from the phone.
    If you get a ethernet connection to your router / hub working and disable wifi then the only way for the data is to go via the ethernet connection.
    for the unity application on windows does not care about if the data comes via wifi or ethernet.
     
  5. Paul-van-der-Laan

    Paul-van-der-Laan

    Joined:
    Oct 12, 2013
    Posts:
    60
    I believe I first need to buy the Apple Lightning to USB 3 Camera Adapter in order to get an ethernet connection, so I can only test that later.

    But shouldn't the iPhone hotspot feature in combination with lightning to USB cable also work? I can establish a network connection between my iPhone and my pc where the iPhone acts as a (3g/4g) hotspot for the PC to have internet. This solution also works with Reallusion iClone, but I'm not able to make a connection with Unity Live Capture this way.
     
  6. Paul-van-der-Laan

    Paul-van-der-Laan

    Joined:
    Oct 12, 2013
    Posts:
    60
    I bought a cheap ethernet + power delivery adapter (this one to be precise) but unfortunately I wasn't able to make a proper network connection between my iPhone 13 and my windows 10 pc.

    At the same time, I also tried the USB cable hotspot approach again and after setting the network connection from public to private (as explained in the docs ) it seemed to work finally. One downside of this workflow is that I need an active sim card for the hotspot feature to work but at least I can get stable facial motion capture data into Unity now.