Question Oculus Mixed Reality Passthrough Mode API Via XR integration

Hey folks,

I've built my game and libraries on top of XR Interaction. With the mixed reality support just exposed on Oculus 2, is there a way I can integrate the pass through features while still maintaining use of the XR Interaction infrastructure?

Is this planed to be exposed in the Unity XR API at some point? or would I need to port by work back over to the Oculus Integration framework to support mixed reality?


Thanks

 

You can run Oculus Integration together with XRI. You only need to add the VR Folder from the Intergration and add an OVRManager to the scene. The rest can stay the same. Cactus Cowboy Passthrough works this way.

 

@dpcactus - thanks for this info. I'll give it a shot!

** updated ** doubling back to verify, that dropping the OVRManager and OVRPassthroughLayer into the project did the trick!

 

@slippyfrog
How did you manage that exactly?
I’ve tried adding 1) OVR Manager + 2) OVR Passthrough Layer to the scene
Beside the original XR Rig, and I had no luck
Can you please tell how did you handle it in your situation

 

Hi! I did the same , but no luck , please share how you did this , thanks!

 

I put an OVR Manager in the scene, next to the XR Rig. Then added an OVR Passthrough Layer component to the XR Rig itself. It worked for me. Hope it helps!

 

Also i can't activate passthrough with xr rig

 

I think I found the problem, with the HDR field disabled on the referenced URP Pipeline assets, it works.

 

Ok after much finagling here's how I got it to work. Used this article as a base (great tutorial) https://skarredghost.com/2021/10/01/how-to-passthrough-ar-oculus-quest-unity/ But do not follow the advice he gives on using XR Interaction kit (I tried it, seems probably no longer valid).

Here's what worked:

I think the key was adding the 'XR Origin (Action based)' to the scene AFTER adding the OVRCameraRig.
It doesn't add a Main Camera object to the XR Origin.
Also make sure, that the CenterEyeAnchor is enabled (checkmark to the right of the blue camera icon):


@ForliReply the HDR enabled or disabled in the settings didn't seem to make a difference, for some reason :|

Here's the setup:

and

 

UPDATE:

***Getting XR interaction CAMERA + CONTROLLERS to work with Passthrough (using OVR camera rig)***

1. Install the XR Interaction Manager package (seems to be important to do this BEFORE adding the OVRCameraRig from the Oculus Interaction)

2. Follow the project and scene setup as described in this excellent tutorial https://skarredghost.com/2021/10/01/how-to-passthrough-ar-oculus-quest-unity/

3. Place the OVRCameraRig inside the XR Origin (Action Based)

4. Set the CenterEyeAnchor camera as Main Camera in the XR Origin (Action Based)

5. Disabled the Main Camera in the XR Rig.

6. Disabled the Left and Right hand anchors


7. Make sure the interaction managers selected for your controllers and interactables is the XR Interactions Manager (and NOT the OVRCamera rig or anything to do with the Oculus Integration)

 

Hey, thank you so much!! I found this post after 7 hours of trying to set things up, it works fine on the Quest Pro.

As an addition for beginners: This video explains how to set up the XR Interaction Handcontrollers:

Cheers!

 

Does anybody know if it is possible to make the passthrough API work with the OpenXR plugin? It seems to work when ONLY the Oculus plugin is enabled in XR plugin management, but when either OpenXR or both is enabled, the background simply turns black.

I am trying to use the hand-tracking feature from XR Toolkit 2.3.0, which required the OpenXR plugin to be enabled, and ideally, I would combine this with the Oculus Passthrough API.

 

This thread is helping me right now: https://forum.unity.com/threads/pos...ough-api-work-with-the-openxr-plugin.1412400/

EDIT: just realized you're the OP thank you for kicking off that additional thread and I'll keep this here in case anyone is looking in the future too. I'm also actively investigating this. If you want to stay in touch, you can find me on Discord or GitHub at the following username: farmerinatechstack.