Search Unity

  1. Unity 2019.1 is now released.
    Dismiss Notice

ARPointCloudMeshVisualizer

Discussion in 'Handheld AR' started by Ryhter, May 21, 2019.

  1. Ryhter

    Ryhter

    Joined:
    Jun 3, 2017
    Posts:
    3
    Hello, I was testing the ARPointCloudMeshVisualizer component, as the documentation says it creates a mesh of a Point Cloud. But, during my tests, I couldn't manage to make it work and create a mesh of the Point Cloud (Feature Points) I was tracking.

    Anyone have tested this component?
    Any suggestion/tips on how to use it properly?

    The particle system visualization is ok, but I need a better picture of the tracked point cloud. A mesh or stable dots on feature points would be ideal.

    Thanks in advance.
     
  2. tdmowrer

    tdmowrer

    Unity Technologies

    Joined:
    Apr 21, 2017
    Posts:
    476
    The
    ARPointCloudMeshVisualizer
    uses a
    UnityEngine.Mesh
    with MeshTopology.Points. It does not generate a triangle mesh.

    There are a few third party solutions that try to generate a mesh from the feature points, but it isn't an out-of-the-box feature of ARFoundation.
     
  3. Blarp

    Blarp

    Joined:
    May 13, 2014
    Posts:
    156
    Look up delaunay triangulation in regards to meshing point clouds.

    Here is a similar method, keyword is "Convex hull": https://gist.github.com/YclepticStudios/c0d8cea56ee1e1d9714754ee9427085b
    https://medium.com/@ugiacoman/arkit-tool-or-toy-bbaf8cd70338

    It's an extremely high level geometry problem, mostly because of the dynamic nature of point clouds.

    Your next question (in the future) will be in regards to texturing the mesh. This is the best explanation of the process: https://forum.unity.com/threads/poi...-position-without-a-mesh.403132/#post-2627318


    I harassed this guy recently, but I didn't get any sauce out of him: https://mobile.twitter.com/RozzaTozza/status/1110654036167065600


    Other random research:

    SDF keyword:
    Shader: https://pastebin.com/raw/u8vv3iwG
    Deep Learning: https://arxiv.org/abs/1612.00593

    Raymarching
    https://github.com/Flafla2/Generic-Raymarch-Unity
    https://www.groundai.com/project/de...-distance-functions-for-shape-representation/
    https://github.com/xraxra/SDFr
    https://www.alanzucconi.com/2016/07/01/signed-distance-functions/
    https://github.com/hecomi/uRaymarchingExamples
     
    Last edited: May 21, 2019
  4. Ryhter

    Ryhter

    Joined:
    Jun 3, 2017
    Posts:
    3
    Thanks for the feedback!

    I also have found this demo:


    So, creating a mesh is a difficult task. But, is there a way to just have a look at the collected point cloud as shown in 0:19 of the video?

    No mesh creation, just to make visible the points od the point cloud in the Unity space?
     
  5. Blarp

    Blarp

    Joined:
    May 13, 2014
    Posts:
    156
    arcore has something new like that built in, can't seem to recall the name.

    Thats actually what rozza is using in the above link, i forgot till you said something about point cloud visualization.
     
  6. Ryhter

    Ryhter

    Joined:
    Jun 3, 2017
    Posts:
    3
    Do you know if it's accesible via Unity? Or I should work natively for this?