Search Unity

  1. Good news ✨ We have more Unite Now videos available for you to watch on-demand! Come check them out and ask our experts any questions!
    Dismiss Notice

Cross-Platform Fixed Foveated Rendering (FFR) with Vulkan for VR

Discussion in 'VR' started by ROBYER1, Oct 15, 2019.

  1. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
    I have just seen in the Oculus Connect 6 talk about Vulkan for VR, they have announced that Vulkan has it's own Fixed Foveated Rendering feature through the Vulkan Fragment Density Map which is completely cross-platform and not tied to Qualcomm hardware.

    Will this be added as a feature once Unity supports Vulkan for the Quest?
    It sounds like it will be very useful for scalable performance boosts on all supported Vulkan platforms such as Windows and Android VR! See more details in the video below:

    snip.PNG



    VK_EXT_fragment_density_map extension
     
    aoeu642 likes this.
  2. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
    ArchVizPRO and ugur like this.
  3. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
    As a quick update, it looks like MultiPass rendering on quest supports Vulkan which also supports FFR on UniversalRP. However Vulkan with Multiview rendering isn't ready yet so I haven't looked into it.

    How to activate FFR with Oculus XR Plugin is not yet documented either, although the changelog seems to say the functionality is there.
     
  4. hippocoder

    hippocoder

    Digital Ape Moderator

    Joined:
    Apr 11, 2010
    Posts:
    26,727
    One of the better things about the vulkan implementation is you can properly segregate the various parts of the screen to be rendered for multi resolution shading. It's not easy to do but you could for example have sky being a lower shading rate, or darker areas of the screen being a lower resolution - it's not just a circular or (fixed) foveated but dynamic.

    If you had a transparent HUD then you could also mark those areas out so the first pass is rendered lower res behind those elements.
     
    ROBYER1 likes this.
  5. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
    Still wondering when we can actually use UniversalRP (URP) with FFR for the Oculus Quest, it was advertised as being usable back in September 2019 at this video, where they even talk about using UniversalRP before announcing that FFR basically doesn't work with it..
     
  6. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
    Claytonious likes this.
  7. Elin42

    Elin42

    Joined:
    Oct 21, 2014
    Posts:
    22
    Everywhere i see the BIG news but when I try it:
     

    Attached Files:

    ROBYER1 likes this.
  8. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
    That is built into the code for the Oculus Integration pack, a line of code that checks if you are building with Vulkan and disables it (daft I know), double click the error to where that line is and comment it out. Or google it if you are stuck other people have had the same issue.
     
    Elin42 likes this.
  9. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
    Dark-Table likes this.
  10. LB_Chris

    LB_Chris

    Joined:
    Jan 29, 2020
    Posts:
    10
    Hey, so far I have got vulkan and multiview to work. Problem is, that using any (even empty) CustomRenderPassFeature breaks the multiview. The right eyes rotation seems of and objects move away the further they move to the side of the right eye screen. Any idea if that is a bug or if CRPF are simply not supported on Vulkan & URP yet? Note that this doesn't happen on multipass.
     
    ROBYER1 likes this.
  11. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
    Please report as a bug using Unity Bug Reporter, the Devs won't see it here.
     
  12. jamie_dubit

    jamie_dubit

    Joined:
    Jan 8, 2015
    Posts:
    5
    So, URP + MultiPass Stereo Rendering + Vulkan = FFR? Is this automatic, I see no APIs to activate it. I'm using XR Plugin Management, rather than the Oculus Integration?
     
    Last edited: Feb 26, 2020
  13. ROBYER1

    ROBYER1

    Joined:
    Oct 9, 2015
    Posts:
    855
  14. jamie_dubit

    jamie_dubit

    Joined:
    Jan 8, 2015
    Posts:
    5
    Ah, excellent. I had the wrong version selected. Thanks
     
unityunity