Resolved Rendering a background behind everything (3D Skybox)

Is there a good way to render a static background, consisting of multiple models behind everything in the scene?

I already tried several ways but each has its own problems.
These are the two most promising:

1) Overwrite position in the view matrix
- Requires a special hand written shaderfor each kind of background object
- Cannot use ShaderGraph (cannot change view matrix)
- Strange selection behaviour in scene view as object is selected in another place than its rendered
2) Camera stacking (3D Skybox setup from URP samples)
- Needs 3 cameras to work with transparancy: https://forum.unity.com/threads/urp-package-samples.1136827/#post-7733028
- Does not work on Oculus Quest
- Refraction effects dont work properly as it can only grab from one opaque texture.
- Depth sorting is tricky (Cameras need to have matching near/far planes)

Would be glad for any input how to properly do this.

 

That might help. Is it possible to clear the depth buffer after these objects have been rendered? Otherwise it will only work without z sorting I guess?

 

Thanks, the custom pass solution seems to be what I was looking for

The 3D skybox setup from the sample (+additional transparency camera) is what I am using atm.
But it causes to many problems (e.g camera stacking not working on Quest)

Any guess when the sample will be released?
Just wondering if I should wait or start my own implementation now.

 

I got it to work with multiple render features.
It works nicely with the added bonus of rendering correctly in scene view too.

I have trouble getting it to work properly in VR though.
The multiple render layers and stencil buffer work but I am not sure how to properly set custom position and clip planes for the VR matrices.

It looks like the standard implmentation of the RenderObjectsFeature didn't even bother to implement it as it just logs this message if in VR mode:

Code (CSharp):

1. "RenderObjects pass is configured to override camera matrices. While rendering in stereo camera matrices cannot be overridden."

My attempt at setting the matrices seems to be wrong as it makes the background vanish:

Code (CSharp):

1.  
2. Matrix4x4[] cameraProjectionMatrices = new[] { cameraData.GetProjectionMatrix(0), cameraData.GetProjectionMatrix(1) };
3. Matrix4x4[] projectionMatrices = new[] { cameraData.GetProjectionMatrix(0), cameraData.GetProjectionMatrix(1) };
4. Matrix4x4[] viewMatrices = new[] { GL.GetGPUProjectionMatrix(cameraProjectionMatrices[0],false),
5.     GL.GetGPUProjectionMatrix(cameraProjectionMatrices[1],false) };
6.  
7. Vector4 leftEyePosition = viewMatrices[0].GetColumn(3);
8. Vector4 rightEyePosition = viewMatrices[1].GetColumn(3);
9. Vector3 leftToRightEye = (Vector3)rightEyePosition - (Vector3)leftEyePosition;
10.  
11. if (this.CameraSettings.OverridePosition)
12. {
13.     leftEyePosition.x = this.CameraSettings.Position.x + leftToRightEye.x * -0.5f;
14.     leftEyePosition.y = this.CameraSettings.Position.y + leftToRightEye.y * -0.5f;
15.     leftEyePosition.z = this.CameraSettings.Position.z + leftToRightEye.z * -0.5f;
16.  
17.     rightEyePosition.x = this.CameraSettings.Position.x + leftToRightEye.x * 0.5f;
18.     rightEyePosition.y = this.CameraSettings.Position.y + leftToRightEye.y * 0.5f;
19.     rightEyePosition.z = this.CameraSettings.Position.z + leftToRightEye.z * 0.5f;
20. }
21.  
22. viewMatrices[0].SetColumn(3, leftEyePosition + this.CameraSettings.Offset);
23. viewMatrices[1].SetColumn(3, rightEyePosition + this.CameraSettings.Offset);
24.  
25. RenderingUtils.SetStereoViewAndProjectionMatrices(cmd, viewMatrices, projectionMatrices, cameraProjectionMatrices, false);
26.  

I also tried calling

Code (CSharp):

1. cameraData.xr.UpdateGPUViewAndProjectionMatrices(cmd, ref cameraData, false);

which should just update the matrices with correct data but it also comes out wrong.

Any clues what I am doing wrong here?
Does it even make sense to adjust the existing matrices or would it be better to reconstruct the matrices from scratch?

 

You are right @ThomasZeng . A made a copy paste error there.
But the problem stays.
I cannot get the correct stereo view and projection matrices after calling

SetViewAndProjectionMatrices

because it just adds commands to the command buffer instead of updating the matrices immediately.

UpdateGPUViewAndProjectionMatrices

also just grabs the current (non modified) matrices and applies them.

Is there any way to create the proper stereo view and projection matrices from the mono versions?
There does not seem to be any exposed unity method to do so. The only ones I can find lead to closed C++ code.

I would really love to look inside

Camera.GetStereoViewMatrix

and

Camera.GetStereoNonJitteredProjectionMatrix

and see how its implemented.

My current implementation for recreating the view matrix is pretty naive and only works if the camera position is at 0:

Code (CSharp):

1.  
2. public static Matrix4x4 CreateStereoViewMatrix(Matrix4x4 view, float stereoSeparation, int eyeIndex)
3. {
4.     var stereoViewMatrix = view;
5.     stereoViewMatrix[12] += stereoSeparation * 0.5f * (eyeIndex*2f-1f);
6.     return stereoViewMatrix;
7. }
8.  

 

Hi! From what I understand, it mean all environments shaders need to be customized to add stencil support right? Any way to avoid this? Also, why default URP don't have a stencil option? Does this option have an important cost on the shader performance?

I thought about setting a skybox shader directly with a stencil option (to avoid changing all enviro shaders), tried that with no luck. I guess it could not work as URP skybox draw after opaque right? Last solution would be a gigantic reversed cube / sphere to act as a stencil mask, but it's probably not the most efficient / practical.

I'm not expert into rendering, but I wonder why we need a stencil at all. There is no solutions to draw the 3D Skybox meshes first somehow?

 

No you dont need to set this up in the individual shaders.
Render features (RenderObjects in this case) allow you to render specific layers with specific paramaters such as depth and/or stencil buffer settings.

You just need to setup a RenderObjects render feature in you URPRendererData Sciptable Object and set it up to render one layer while writing to stencil buffer and then another RenderFeature rendering another layer while comparing to the stencil buffer.

You will probably end up using more than 2 render features as you will have to render transparency separately etc.

 

Oohhh I understand now!
After some tries I finally found a configuration that work, I used the default override to set all the default layers to use a stencil, then did the operation on the 3D skybox layer on the renderer feature and it worked

Now the only issues remaining is the 3D skybox disappearing when I look around (I think it's related to frustrum culling, as it must use the player camera and not the matrix I use) and specular lighting or something else that change relative to player position.

PS: Did you figured out the StereoViewMatrix? Because I think I resolved this on my side, by using another camera to get it's viewMatrix (disabled so it don't take any resource).

 

Apologies for the semi-necro, but I'd also be interested to know any details regarding StereoViewMatrices and how the workarounds described here are implemented. I've written a few shaders before (and a bunch more shadergraphs), but graphics isn't exactly my strongest area of expertise.

I have exactly the same problem as OP in that I need a 3d skybox and can't afford camera stacking, probably in part because I'm stuck with a tile-based renderer. I implemented the render feature strategy instead and the results are promising, but I'm hung on the matter of getting it to behave correctly stereoscopically. It would be useful if I could modify the skybox FoV, but I don't desperately need to. It would be enough to ensure the skybox always rendered behind the main scene. That works in my current implementation, just not in stereo. Instead it renders once and is just placed in both eyes. Anyone have any tips on how I might accomplish that? Do I need to re-implement Render Objects from scratch and build stereo support in?