Official XR Interaction Toolkit 2.3.0 and updated Example project out of preview

Anybody else having issues with having hands showing up in HandsDemoScene?

Everything else in the scene works - I can push and manipulate everything properly in the scene. I can also see raycasts coming out of where my hands should be. However, I don't actually see my hands rendered in the scene.

- Unity 2022.2.10f1 (Apple Silicon)
- XR Hands 1.1.0-pre.3
- XRI Toolkit 2.3.0
- XR Plugin Management 4.3.3

 

I had a few issues as well, but was able to resolve them. The prefabs weren't set up correctly when I updated to 2.3.0 and I had to do a few things, like setting the prefabs in the inspector for the hands and turning off the velocity view (which is likely the raycasts you are seeing). There were also several issues with materials having a broken shader, so I switched them to use the Standard with specular setup.

 

Something that should probably be in the upgrade instructions is to delete any samples from the older versions. Because samples are installed under a folder with the version number, it won't overwrite the old version samples and then you'll have duplicate GUIDs.

The new PokeInteractor and hands samples are a nice addition and a great step in the right direction! One thing that I did notice was that if you rotate the numpad to be vertical (like it was on a door that you had to enter a code to unlock), then the poke interaction is problematic. If you poke directly in front of you, your index finger curls downward just as you are getting to the buttons, making it where you actually select the button below the one you aim for. If you move your head to one side so you can see your hand from an angle, it doesn't curve nearly as much and you can usually hit the right number or at least get much closer. I took a video of this (on Quest2 w/ Link) if you can't repro it on your end.

 

My project is using the built-in renderer, so it was definitely not the URP materials issue that I've seen before in some of my SRP projects.

I'll have to test again with importing the new samples. I had moved them into a different folder, so maybe it is looking for them specifically in the original install folder?

I can't tell yet what is causing the curling for sure, but it seems likely that it is the hand tracking. When I have the numpad directly in front of my view and reach my finger towards it, I get the curling just before I reach the buttons. Here you can see from the Scene view how it is fairly straight and then curls as I get closer.


But if I come at the button from the side, so I can see my full finger, it remains straight - although every once in a while it puts out two fingers, like a peace sign, instead of just pointing with one.



But as I play around a bit more away from the numpad, it seems like it is likely happening as my hand reaches a distance from the HMD and that just happened to coincide with the numpad distance. When I just point away from me in mid air, I start seeing a similar behavior, like it is starting to assume a fist. Without the numpad there, it's just harder to notice the effect since your finger isn't very visible but the buttons on the numpad still were.

Happy to help, glad to see the way this new API is shaping up.

 

UPDATE: Just after sending this, I realized I could test in the Home environment in the Quest and it looks like the fingers are curling there in the exact same way, so it is the hand tracking data coming in, not something coming from your code.

 

A big thanks to the team for the great work. The main demo is really neat and now includes a lot of concrete examples (like the hammer, locked doors and drawers) like the ones I had previously built by myself for students. There are a lot of features I still didn't try out, but it's already big step-up from the previous version.

 

Thanks for the great work! When ca we expect a PackageManager Integration? It's a little bit difficult to find the project

 

Does it support finger tracking for index controllers and oculus?

EDIT: The official Unity plugin XR hands works and provides index controller finger tracking

 

Great work Dave and team. Loving the new example and samples. XR Hands is awesome.

 

Anyone else have problem using these two scripts from XR starter assets?
ActionBasedControllerManager
DynamicMoveProvider

Create empty project, import XR Interaction Toolkit 2.3.0 or 2.3.1
Try to add ActionBasedControllerManager DynamicMoveProvider scripts.

Reimport work only on local PC, if you use source control every person have to reimport manually on their computer.

 

Congrats to the team for the new release!

 

Really nice demo scene, thank you to the devs for setting this up.

I'm trying to make a Quest game and wondering if there's (anywhere on the internet) a walkthrough of the type of steps needed to make this main scene performant on Quest. I know this scene wasn't built with Quest in mind but still, would be a useful reference. Here's what I tried so far:

• Take default setup, switch to android build
  • build, export: runs on Quest 1 (wow! very cool) but at ~25 fps
• Then disable the following:
  • all water
  • all the Station Light objects
  • PostProcessing Volume
  • build, export: still ~25 fps
• Then
  • Add Occlusion Culling
  • Disable "Cast Shadows" on all MeshRenderers
  • build, export: still ~25 fps
• what else to try?

The main reason why I want a Quest build of this is so I can give it to my Quest QA testers as an apk build and ask them "what do you think about this interaction type, or that one?"

Thinking maybe someone already wrote some notes on this, but google did not help me here. Thanks in advance.

 

I have been using 2.4.3 and both hand demo works but picking up controllers does not switch to controllers. Any ideas what might be the issue?

 

@VRDave_Unity Hi

I got some feedback to the XR Hands ( they are awesome!) But the pinch to grab could need some love.
https://forum.unity.com/threads/hand-pinch-is-not-intuitive-it-needs-a-grab.1535290/

 

Hi!

Thank you for the examples!

I find it quite tricky so far to substitute the effect of GravityApplicationMode.Immediately that was under ContinuousMoveProviderBase in 2.5, using the LocomotionMediator.
Basically, if now you stand on a platform that moves up and down by physical forces and not transform change, your character will now block this physical interaction.

Looking forward to see an implemented example or the addition of gravity applicaiton mode in the LocomotionMediator.