Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. Join us on March 30, 2023, between 5 am & 1 pm EST, in the Performance Profiling Dev Blitz Day 2023 - Q&A forum and Discord where you can connect with our teams behind the Memory and CPU Profilers.
    Dismiss Notice
New Forum User Notice Performance Profiling Dev Blitz Day 2023

ARFoundation - How to get camera orientation?

Discussion in 'AR' started by grubertm, Apr 16, 2019.

  1. grubertm

    grubertm

    Joined:
    Jan 9, 2018
    Posts:
    8
    When calling TryGetLatestImage() I get the camera image in whatever orientation the device might consider its default. What is the recommended way to query that orientation?
    For example if I start the app in Portrait orientation the data I get from TryGetLatestImage() might be in Landscape Left or Landscape Right. Where is that information exposed?
     
    grubertm, Apr 16, 2019
    #1

  2. tdmowrer

    tdmowrer

    Unity Technologies

    Joined:
    Apr 21, 2017
    Posts:
    605
    TryGetLatestImage exposes the raw, unrotated camera data. It will always be in the same orientation (landscape right, I believe). The purpose of this API is to allow for additional CPU-based image processing, such as with OpenCV or other computer vision library. These libraries usually have a means to rotate images, or accept images in various orientations, so we there is no built-in functionality to rotate the image.

    For what are you using the camera image, and why do you need to rotate it?
     
    tdmowrer, Apr 16, 2019
    #2

  3. grubertm

    grubertm

    Joined:
    Jan 9, 2018
    Posts:
    8
    We have an existing tensorflow segmentation model that was trained on portrait oriented images. I would like to feed the AR Foundation image to it but for that I first need to know whether any rotation needs to be applied or not.
     
    grubertm, Apr 16, 2019
    #3

  4. grubertm

    grubertm

    Joined:
    Jan 9, 2018
    Posts:
    8
    Last edited: Apr 16, 2019
    grubertm, Apr 16, 2019
    #4

  5. tdmowrer

    tdmowrer

    Unity Technologies

    Joined:
    Apr 21, 2017
    Posts:
    605
    tdmowrer, Apr 17, 2019
    #5

  6. grubertm

    grubertm

    Joined:
    Jan 9, 2018
    Posts:
    8
    I would think Screen.orientation only solves half the problem. It tells me how the screen is oriented. It doesn't tell me how the device's camera is oriented/mounted with regards to the screen.
     
    grubertm, Apr 17, 2019
    #6

  7. tdmowrer

    tdmowrer

    Unity Technologies

    Joined:
    Apr 21, 2017
    Posts:
    605
    It should always be the same. Are you finding it different on different devices?
     
    tdmowrer, Apr 17, 2019
    #7

  8. grubertm

    grubertm

    Joined:
    Jan 9, 2018
    Posts:
    8
    grubertm, Apr 17, 2019
    #8

  9. tdmowrer

    tdmowrer

    Unity Technologies

    Joined:
    Apr 21, 2017
    Posts:
    605
    A previous version of Google's computer vision sample for the ARCore Unity SDK obtained the physical camera's orientation. Here is how they did it: https://github.com/google-ar/arcore...sion/Scripts/ComputerVisionController.cs#L248

    Luckily, it's all in C#, so you should just be able to copy and paste 
    _GetCameraImageToDisplayRotation
    for your own needs. I'll also see about getting this into AR Foundation proper.
     
    tdmowrer, Apr 19, 2019
    #9
    grubertm likes this.

  10. grubertm

    grubertm

    Joined:
    Jan 9, 2018
    Posts:
    8
    Great. Thank you for your help Tim!
     
    grubertm, Apr 19, 2019
    #10

  11. vincentfretin

    vincentfretin

    Joined:
    Jul 4, 2019
    Posts:
    7
    For anyone finding this thread, I put some code using Screen.orientation on this GitHub issue
     
    vincentfretin, Aug 26, 2019
    #11
    D3m0n likes this.

  12. D3m0n

    D3m0n

    Joined:
    Nov 11, 2014
    Posts:
    143
    Incredible how nothing has been implemented yet in the ARFoundation example. It seems to me a very fundamental thing for the full functioning of the example itself. Could I ask you to fully coexist the part of code to rotate the preview correctly? There are some parts that I can't understand. Thank you
     
    D3m0n, Jul 23, 2020
    #12
    zacharyaghaizu, Imhotebkin and NoProgrammer like this.