Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.

Questions about Functionality

Discussion in 'Unity Reflect' started by MorphusTwo, Dec 5, 2020.

  1. MorphusTwo

    MorphusTwo

    Joined:
    Mar 12, 2014
    Posts:
    2
    Hi Guys,

    Got a few questions about 1:1 AR, hoped someone here might be able to shed some light...

    Plane detection - Using the Samsung S9, I've noticed that plane detection doesn't work on single colour surfaces. eg: White Walls, Beige Walls etc.. if there's a pattern it picks it up straight away. Anyone else experiencing this? Hardware issue?

    Tracking - When walking around, the model "shifts". Is this due to the tracking ability of the S9? Distances also don't seem relative eg: taking 1 step in the real world doesn't equal the same distance travelled in the AR model.

    Positioning and model placement - Are there better ways to place and track the model? For example gamma AR seems to place and track very well. Measuring 1 wall to get placement and scale I believe. Can we place the model and never update its position again? Is it the cameras/hardware's own positional sensors that are causing the issue or is reflect updating the position of the model based on sensor data? eg: depth camera, plane detection etc.

    What is the best device for reflect 1:1 AR?

    How do you access the model elements via code? If we are loading them at runtime from our various environments, cloud, local, bim360. I can't seem to get a reference to them. I've looked at the samples but when applying the same techniques to my cloud models it doesn't seem to recognize them. Even the basic filtering and instancing.

    Selection and functionality inside the 1:1 AR seems to be turned off, is the BIM meta data display supposed to work in AR? models no longer highlight either.

    Overlay - Is it possible to overlay our models instead of replacing the environment? Semi transparency? is that just shaders or is there more going on there?

    Thanks whomever take the time to look at these, appreciate you.

    Kindest regards,

    Chris
     
    MorphusTwo, Dec 5, 2020
    #1

  2. DavidMenard

    DavidMenard

    Unity Technologies

    Joined:
    Jun 3, 2019
    Posts:
    113
    Hey @MorphusTwo,
    We rely on ARKit and ARCore for AR tracking, so you'll experience the platform limitations when using AR in Reflect. While testing, we found that the new Apple devices with Lidar sensor greatly improve both detection and tracking, so we highly recommend the new iPad Pros or iPhone 12 for 1:1 AR.
    We're looking on improving our AR features in the future and we'll enable BIM selection while in AR mode. We're also looking at adding Occlusion, which would allow us to overlay our models, instead of replacing the environment, but note that this is a feature that's only available on Apple devices with Lidar sensors, as you need a 3D representation of the environment.

    I'll have someone from the team answer you questions about how to access the models. The samples are typically our references on how to do this, but you can also look at the App's source code here.

    David
     
    DavidMenard, Dec 7, 2020
    #2

  3. MorphusTwo

    MorphusTwo

    Joined:
    Mar 12, 2014
    Posts:
    2
    Hi David, Thanks for getting back to me.

    Spoke with Bradley and Fred Yesterday so got everything I needed form that call for the time being.

    Yup, tracking issues seem to be purely hardware/Kit/Core I need to dive into how its implemented here. (If you know where is handled script wise please let me know.)

    I have the 2020 with LiDar but no apple developer license.. real pain to get get sorted.

    We went through a bunch of stuff and identified a number of "not working as intended functionality", selecting while in AR, Filtering, BIM meta data whilst in AR etc.. I'll put together a little doc with pics and get it through the the team.

    The occlusion sounds interesting, looking forward to updates about that.

    Anyways thanks again, I'll have another crack at it and get back with results.

    Kindest regards,

    Chris
     
    MorphusTwo, Dec 8, 2020
    #3
    DavidMenard likes this.