Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Dismiss Notice

Question AR Foundation Enviroment Probe Blur in ArCore ?

Discussion in 'AR' started by yumeng1022, Sep 11, 2020.

  1. yumeng1022

    yumeng1022

    Joined:
    Dec 4, 2019
    Posts:
    15
    Hi Guys,
    i get very blur enviroment probe from ArCore as below , compare with Unity show enviroment probe in arkit.
    i'm curious any steps should i follow to get sharp probe cubemap/image compare with arkit show below ? Or naturally Arcore's enviroment probe is indeed blur compare with arkit?
    (Note : i'm using below config:
    Unity 2020.1.4 ,
    ArCore PlugIn version is 4.0.8,
    Ar Foundation PlugIn version is 4.0.8,
    URP project and HighQuality
    Phone : OnePlug 6
    Attach Probe Manger to ArSession Origin as below
    upload_2020-9-11_23-28-52.png

    Result
    Left is Arcore from my apps , Right is ArKit from Unity
    upload_2020-9-11_23-23-13.png
     
  2. strandedhuman

    strandedhuman

    Joined:
    Aug 22, 2020
    Posts:
    5
    Did you ever figure this out? I'm having the same issue...
     
  3. andreasjakl

    andreasjakl

    Joined:
    May 25, 2018
    Posts:
    1
    Google uses an AI-based approach to approximate the lighting of the environment based on little information (single / few 2D camera images), to ensure that it works in real-time also on mid-range phones. As such, the resolution of the maps is rather low, and the intention is mainly to get the general "light field reflection" right - not so much to create a realistic map of the environment.

    As such, with ARCore, if you apply reflectiveness to a material, it should generally match the light situation in the room. But you will not see much of a real object reflectance; only general brightness, and color tendencies.

    I've taken a closer look at the underlying algorithms that Google is (most likely) using in ARCore and summarized them here: https://www.andreasjakl.com/environ...eflections-in-arcore-human-perception-part-1/
     
    adam_unity450 likes this.
  4. shibi2017

    shibi2017

    Joined:
    Jan 18, 2018
    Posts:
    153
    hello andreasjakl, I have a question related to the env probe, can I have your reply if you're convenient?
    it is: Is there good method to make in-game object reflect other gameobjects and enviornment at same time? in my paractice it only reflect one of them
     
  5. davidmo_unity

    davidmo_unity

    Unity Technologies

    Joined:
    Jun 18, 2019
    Posts:
    99
    You may want to look into Reflection Probes or implementing screen space reflections. Note that these techniques can be prohibitively expensive especially on mobile platforms.

    Additionally: Providing some context on blurry ARCore environment probes. The environment probe on ARCore is generated via the incoming camera data to generate a very low resolution cubemap. 16x16x6 texture faces approximating environment global illumination that is intended to be used on rougher materials to provide color rather than true reflections.
     
  6. shibi2017

    shibi2017

    Joined:
    Jan 18, 2018
    Posts:
    153
    hi, david, thank you for your reply.
    And still a question: can I use refelction probes and ar env probes at same time to get an effect that my object's reflection influenced by both reality and other objects in game?
    In my test when I add a relection probe and an ar env probe, they won't work at same time, one always overlap the another.
    Is there any way to make it?
     
  7. davidmo_unity

    davidmo_unity

    Unity Technologies

    Joined:
    Jun 18, 2019
    Posts:
    99
  8. davidmo_unity

    davidmo_unity

    Unity Technologies

    Joined:
    Jun 18, 2019
    Posts:
    99
    You could also manually do it by blending the virtual reflection probe cubemap and the AREnvironmentProbe cubemap using ReflectionProbe.BlendCubemap
     
  9. shibi2017

    shibi2017

    Joined:
    Jan 18, 2018
    Posts:
    153