Search Unity

Question Problem with exoplayer bridge in Unity. Stuttering on high resolutions.

Discussion in 'VR' started by Yaramir_, Feb 18, 2021.

  1. Yaramir_

    Yaramir_

    Joined:
    Feb 1, 2021
    Posts:
    2
    Hey guys!
    We have an interesting stuff to investigate.
    The problem is with exoplayer bridge in Unity. The problem is that on Oculus Quest 2 it looses frames on 8K resolution videos 60 fps. It looks like stuttering on high resolutions/fps.
    We have checked it on AVPro version 1.11.7 and 2.0.6. Also we have checked it on our own Exoplayer bridge. (They use exoplayer 2.12.1 and 2.8.4). Result is the same, for some reason exoplayer updates the texture with the different delay.
    We have tried AVPro in Unity 2018.4, 2019.4 and latest 2020 version. The behavior is the same, it's skipping frames. For some reason internal Unity Video player (starting from version 2019) is not skipping frames, but it's to slow for our purposes. Also Skybox VR player for Oculus Quest is not stuttering as well, but they use their own fork of exoplayer.
    We have prepared the demonstration video with blinking dots. You can use it to check it on your side.
    Also we've attached apk file for Oculus Quest with AVPro demonstration scene playing in video. You can check how it stutters. Just look to left and right after start. Video is mapped to the standard AVPro 360 mesh. When AVPro will skip the frame you won't see the corresponding dot.
    At the same time CPU and GPU of Oculus Quest 2 is not overloaded at all so the bottleneck is somewhere else.
    If you have any ideas why it could happen, please share your thoughts!
    Thanks in advance!


    Video:
    https://www.dropbox.com/s/a799kpispvyoyz3/vrtest_grid3x2_60fps_8k_hevc_180_180x180_3dh_LR.mp4?dl=0
    APK for Quest/Quest2:
    https://www.dropbox.com/s/78bn21k43hhu2oi/testavpro.apk?dl=0