Question ARFoundation environment occlusion is glitchy

At least when running on android. Take a look at this video:

. The model sinks into the ground, parts of it disappears and reappears, sometimes the object isn't immediately occluded. Sometimes not all of it occluded. Now compare with the ARCore depth api demonstration here:
https://www.youtube.com/watch?v=VOVhCTb-1io and here

None of these problems happen. What's going on?

 

Please help I need to get a decent looking occlusion.

 

BUMP

 

@TreyK-47 Mr Dan Miller from Unity said more about this on discord:

Is the smoothing feature coming along soon?

 

I am making an application where an object needs to be viewed from distance > 10m, and using the "default" AROcclusionManager, the object disappears at this distance.
I read that max depth is 8m (correct me if I am wrong) so this is probably what caused the object disapperance.
At the moment, I am trying to make a simple custom occlusion shader that somewhat replicates what the AROcclusionManager is doing using the AROcclusionManager.environmentDepthTexture, and for example, make the object transparent when it it too far away
I have been able to follow the DepthGradient.shader from ar-foundation samples and could easily convert it to a simple surface shader that does the same thing.
However, for the occlusion shader, I am having problems figuring out how to calculate the proper real and virtual depths.
For now I have:
float virtualDepth = -UnityWorldToViewPos(IN.worldPos).z; // depth of the virtual vertex
float realDepth = GetDepthInMeter(_DepthTex, IN.screenPos.xy);
But it's not right. Maybe some transformation is required to convert the screenPos to the depthmap uv?
What could I do?
Any suggestions for alternative approaches are aslo welcomed.

Thanks a lot in advance

 

BUMP

 

See AROcclusionManager.environmentDepthTemporalSmoothingRequested.

 

@todds_unity What's this, new feature? Decent occlusion is finally available?

 

@todds_unity There is no such option on AROcclusionManager.cs. How do I use this? Thanks!

 

@Marks4 This was added in ARFoundation 4.2 if I remember correctly, so you may need to update if you are currently using an older version of ARFoundation.

Regarding this option though, I noticed that on most devices I have tested on (mainly Samsung devices) it is not really supported. The environment depth map is point filtered rather than using bilinear filtering, which makes occlusion appear very jagged, and basically unusable.

This issue can be worked around with a custom material on the ARCameraBackground, which does the Bilinear filtering in the shader, which makes things look much better, however this is not possible when using URP as far as I know, as URP requires it's own custom background.

Is this a known issue @todds_unity ? Is there a suggested way of filtering the environment depth map when using URP?

 

URP does not require a custom background shader with AR Foundation.

Also, the sampling of the depth texture is not affected by the camera background shader. The temporal smoothing, when enabled, is applied at the native ARCore level.