Search Unity

  1. Unity Asset Manager is now available in public beta. Try it out now and join the conversation here in the forums.
    Dismiss Notice

Annotations not taking into account post processing effects

Discussion in 'Computer Vision' started by NPSimulation, Dec 6, 2021.

  1. NPSimulation

    NPSimulation

    Joined:
    Oct 6, 2020
    Posts:
    7
    Hi!

    Do you think that, in the future, post-processing effects modifying spatial coordinates such as lens-distortion could affect annotations?

    At the moment activating lens-distortion results in my object being deformed but with its annotations aren't affected, as you can see in these images.

    Without post-processing lens-distortion
    WithoutDistortion.PNG
    With post-processing lens-distortion
    WithDistortion.PNG
     

    Attached Files:

    NPSimulation, Dec 6, 2021
    #1
    esgnn likes this.

  2. RuiyuZhang_Unity

    RuiyuZhang_Unity

    Unity Technologies

    Joined:
    Mar 17, 2021
    Posts:
    11
    Hi,

    Thanks for asking! The post-processing effect like lens distortion is only supported on the instance segmentation labeler, semantic segmentation labeler, and bounding box 2d labeler right now. These labelers support lens distortion through a lens distortion render pass that affects both instance and semantic segmentation. However, the keypoint labeler does not use a shader output to detect the screen position of keypoints. Instead, it uses the world to screen function from Unity, which does not take lens distortion into account.

    This issue with the keypoint labeler is known, and we hope that we can address it in the future.
     
    RuiyuZhang_Unity, Jan 21, 2022
    #2