Search Unity

Feature Request XR Interaction Toolkit and Hand Tracking

Discussion in 'XR Interaction Toolkit and Input' started by Bwong3, Jan 16, 2020.

Thread Status:
Not open for further replies.

  1. Bwong3

    Bwong3

    Joined:
    Oct 29, 2016
    Posts:
    1
    Does XR Interaction Toolkit support hand tracking with Oculus Quest (or Magic Leap)? If so, how can I implement? Is there an option in XR Controller script?

    I would also like the option to toggle between hand tracking and controller during runtime. This might be a stretch, but would also like to be able to use at least one controller and hand tracking simultaneously too. Thanks in advanced!
     
    Bwong3, Jan 16, 2020
    #1
    Alex-CG and ROBYER1 like this.

  2. Matt_D_work

    Matt_D_work

    Unity Technologies

    Joined:
    Nov 30, 2016
    Posts:
    202
    Not at the moment, hands are high on our priority list however :)
     
    Matt_D_work, Jan 23, 2020
    #2
    Alex-CG, Fangh, VirtualAwakening and 3 others like this.

  3. mmarkman

    mmarkman

    Joined:
    Feb 21, 2019
    Posts:
    2
    Ayyyyyyyyyyy :D
     
    mmarkman, Jan 25, 2020
    #3

  4. mmarkman

    mmarkman

    Joined:
    Feb 21, 2019
    Posts:
    2
    mmarkman, Jan 26, 2020
    #4

  5. Matt_D_work

    Matt_D_work

    Unity Technologies

    Joined:
    Nov 30, 2016
    Posts:
    202
    Matt_D_work, Jan 27, 2020
    #5
    ROBYER1 and alexchesser like this.

  6. VirtualAwakening

    VirtualAwakening

    Joined:
    Sep 19, 2017
    Posts:
    3
    Is there any update for this?

    "XR Interaction Toolkit support hand tracking with Oculus Quest"
     
    VirtualAwakening, Mar 16, 2020
    #6
    alienheretic, ROBYER1, avanderbergh and 3 others like this.

  7. ebellumat

    ebellumat

    Joined:
    Aug 26, 2019
    Posts:
    3
    And about just the normal fingers? Oculus Quest touch controllers have a great support for fingers, but i don't find any way to put this works on Oculus Quest with XR Toolkit. My hands are static.
     
    ebellumat, Apr 11, 2020
    #7

  8. FishStickies94

    FishStickies94

    Joined:
    Jul 27, 2019
    Posts:
    70
    The implementation is in there under OculusUsages but I can't get any of them to work.
     
    FishStickies94, Apr 13, 2020
    #8

  9. dilmerval

    dilmerval

    Joined:
    Jun 15, 2013
    Posts:
    232
    I think what we are missing is the equivalent to OculusProjectConfig where you can specify the HandTrackingSupport, for instance I set this to HandsOnly when I build hand experiences with the Oculus Integration, what is the equivalent for the XRToolKit?

    I have the code for feature usages where I get the bone info out but it is currently null because the app does not have the proper permissions to use hand tracking.
     
    dilmerval, Apr 14, 2020
    #9
    P_Jong, ariza-oscar and ROBYER1 like this.

  10. dilmerval

    dilmerval

    Joined:
    Jun 15, 2013
    Posts:
    232
    dilmerval, Apr 14, 2020
    #10

  11. LeFx_Tom

    LeFx_Tom

    Joined:
    Jan 18, 2013
    Posts:
    88
    @Matt_D_work I'm chiming in here. The XR Interaction toolkit looks very promising, but I'm actually lacking the feeling, that it is continuously worked on.
    Is there a roadmap or any set plan for features like hand tracking or in general XR HMD support (like HoloLens (2) and MagicLeap)?
    It would be really nice to have one unified toolset to develop applications for all/most HMDs and it is a charming idea, that it could be Unity's "own" maintained solution...but for that, it would need some sort of a reliable development lifecycle...
     
    LeFx_Tom, Apr 22, 2020
    #11
    P_Jong likes this.

  12. Aaron-Meyers

    Aaron-Meyers

    Joined:
    Dec 8, 2009
    Posts:
    305
    Seems like hand tracking would first be offered at a lower level implementation than XRIT.

    Right now, perhaps the greater issue is that you can't use Oculus hand tracking with the XR Management plugin version... only the deprecated older plugin. I think we probably need to see it supported in the XR Management plugin before we can hope that it will find its way into XRIT.
     
    Aaron-Meyers, Apr 22, 2020
    #12

  13. a436t4ataf

    a436t4ataf

    Joined:
    May 19, 2013
    Posts:
    1,933
    Are there two things with that name? (I just logged a bug against all of OculusUsages being broken in current XRIT, and ... there's nothing in the OculusUsages class about hand-tracking)
     
    a436t4ataf, Apr 24, 2020
    #13

  14. FishStickies94

    FishStickies94

    Joined:
    Jul 27, 2019
    Posts:
    70
    The person I was relpying to was talking about the Touch controllers capacitve buttons.
     
    FishStickies94, Apr 25, 2020
    #14

  15. fherbst

    fherbst

    Joined:
    Jun 24, 2012
    Posts:
    802
    @Matt_D_work bumping this again because it's been some more months and we still don't have Quest hand tracking through XR Management. Could you share some plans around this?
     
    fherbst, Jul 25, 2020
    #15
    jmcgraw961, Frizzzer123, Adnaro and 5 others like this.

  16. appels

    appels

    Joined:
    Jun 25, 2010
    Posts:
    2,687
    Bumping for same reason, setting up XR and want to add hand tracking
     
    appels, Sep 2, 2020
    #16
    Adnaro, Desoxi and sikaar like this.

  17. Desoxi

    Desoxi

    Joined:
    Apr 12, 2015
    Posts:
    195
    Bumping this again, as hand-tracking gets more important the more time passes by. And we still have zero feedback.
     
    Desoxi, Sep 23, 2020
    #17
    Adnaro, ROBYER1 and ariza-oscar like this.

  18. daveinpublic

    daveinpublic

    Joined:
    May 24, 2013
    Posts:
    167
    Bumping, as well. It would be nice to hear an update on hand tracking in the XR Interaction Toolkit.
     
    daveinpublic, Oct 4, 2020
    #18
    Adnaro and Desoxi like this.

  19. Aaron-Meyers

    Aaron-Meyers

    Joined:
    Dec 8, 2009
    Posts:
    305
    When hand tracking comes to XR Interaction Toolkit, I would love to see it also support it through iOS/AR Foundation since iOS 14 now has it.
     
    Aaron-Meyers, Oct 4, 2020
    #19
    P_Jong, kahunamoore and HereLen like this.

  20. HereLen

    HereLen

    Joined:
    Feb 5, 2019
    Posts:
    3
    Anything new on this?
     
    HereLen, Oct 16, 2020
    #20
    Adnaro, kahunamoore and daveinpublic like this.

  21. sxnorthrop

    sxnorthrop

    Joined:
    Sep 29, 2014
    Posts:
    43
    Bump :)
     
    sxnorthrop, Nov 1, 2020
    #21
    Frizzzer123 and Adnaro like this.

  22. robinspots

    robinspots

    Joined:
    May 10, 2018
    Posts:
    13
    +1 for this
     
    robinspots, Nov 2, 2020
    #22
    Adnaro and LeFx_Tom like this.

  23. Shizola

    Shizola

    Joined:
    Jun 29, 2014
    Posts:
    476
    There's supposed to be an update coming this week featuring a roadmap.
     
    Shizola, Nov 3, 2020
    #23
    sxnorthrop and gjf like this.

  24. roller_yalta

    roller_yalta

    Joined:
    Nov 5, 2013
    Posts:
    1
    bump, wondering if UI interactions with a Quest hands are coming o_O
     
    roller_yalta, Nov 5, 2020
    #24

  25. mfuad

    mfuad

    Unity Technologies

    Joined:
    Jun 12, 2018
    Posts:
    335
    Hey everyone, at the moment we recommend using the Oculus Integration package if you need to enable hand tracking on Oculus Quest. More information can be found in their documentation. We understand there's a desire to have this supported in the XR Interaction Toolkit, and we will definitely take it into consideration as we plan for subsequent versions beyond the 1.0 release. Please use our public roadmap to give us your feedback so we can monitor everyone's requests and plan accordingly. Going to close this thread, thanks!
     
    mfuad, Nov 6, 2020
    #25
    jmcgraw961, P_Jong, sxnorthrop and 1 other person like this.
Thread Status:
Not open for further replies.