ARPointCloudMeshVisualizer

Hello, I was testing the ARPointCloudMeshVisualizer component, as the documentation says it creates a mesh of a Point Cloud. But, during my tests, I couldn't manage to make it work and create a mesh of the Point Cloud (Feature Points) I was tracking.

Anyone have tested this component?
Any suggestion/tips on how to use it properly?

The particle system visualization is ok, but I need a better picture of the tracked point cloud. A mesh or stable dots on feature points would be ideal.

Thanks in advance.

 

The

ARPointCloudMeshVisualizer

uses a

UnityEngine.Mesh

with MeshTopology.Points. It does not generate a triangle mesh.

There are a few third party solutions that try to generate a mesh from the feature points, but it isn't an out-of-the-box feature of ARFoundation.

 

Look up delaunay triangulation in regards to meshing point clouds.

Here is a similar method, keyword is "Convex hull": https://gist.github.com/YclepticStudios/c0d8cea56ee1e1d9714754ee9427085b
https://medium.com/@ugiacoman/arkit-tool-or-toy-bbaf8cd70338

It's an extremely high level geometry problem, mostly because of the dynamic nature of point clouds.

Your next question (in the future) will be in regards to texturing the mesh. This is the best explanation of the process: https://forum.unity.com/threads/poi...-position-without-a-mesh.403132/#post-2627318


I harassed this guy recently, but I didn't get any sauce out of him: https://mobile.twitter.com/RozzaTozza/status/1110654036167065600


Other random research:

SDF keyword:
Shader: https://pastebin.com/raw/u8vv3iwG
Deep Learning: https://arxiv.org/abs/1612.00593

Raymarching
https://github.com/Flafla2/Generic-Raymarch-Unity
https://www.groundai.com/project/de...-distance-functions-for-shape-representation/
https://github.com/xraxra/SDFr
https://www.alanzucconi.com/2016/07/01/signed-distance-functions/
https://github.com/hecomi/uRaymarchingExamples

 

Thanks for the feedback!

I also have found this demo:

So, creating a mesh is a difficult task. But, is there a way to just have a look at the collected point cloud as shown in 0:19 of the video?

No mesh creation, just to make visible the points od the point cloud in the Unity space?

 

arcore has something new like that built in, can't seem to recall the name.

Thats actually what rozza is using in the above link, i forgot till you said something about point cloud visualization.

 

Do you know if it's accesible via Unity? Or I should work natively for this?

 

Thank you for sharing all this @Blarp. If you found anything new on this topic ever since it would be great to get this thread updated.