Search Unity

Backplate? Replace sky with backplate, or render against black?

Discussion in 'Virtual Production' started by newguy123, Aug 30, 2020.

  1. newguy123

    newguy123

    Joined:
    Aug 22, 2018
    Posts:
    1,248
    Hi Guys

    How do you deal with backplates? Typically we have existing drone shots and or still photogaphy we need to use as background.

    How can we handle this in Unity? The background in 3D is basically the sky or an HDRI or similar, which works well for lighting, but 99% of the time we need to keep the lighting that setup gives, but replace the backplate with a video or still image.

    Is there a solution to this currently?

    Alternatively, how can we render against black, without affecting the lighting, so we can comp in the required backgplate in Nuke/Fusion/AE ?
     
  2. newguy123

    newguy123

    Joined:
    Aug 22, 2018
    Posts:
    1,248
    Soooo does this section of the forum, Film,TV, Animation and Cinematics hardly have any activity, because everybody is using Unreal for such things?
     
  3. wetcircuit

    wetcircuit

    Joined:
    Jul 17, 2012
    Posts:
    1,409
    You can use a UI image. I don't recall the settings off-hand, but there is a way to set the UI image as the background and have it fill the screen (I've done it).
     
    newguy123 likes this.
  4. newguy123

    newguy123

    Joined:
    Aug 22, 2018
    Posts:
    1,248
    Sounds good! Would be awesome if you can recall the settings for it.....
     
  5. wetcircuit

    wetcircuit

    Joined:
    Jul 17, 2012
    Posts:
    1,409
    Looks like I just used a 'screen space' canvas and set the plane to be behind my game objects.

    Screen Shot 2020-09-01 at 3.27.18 PM.png
     
    newguy123 likes this.
  6. newguy123

    newguy123

    Joined:
    Aug 22, 2018
    Posts:
    1,248
    Brilliant, works like a charm in URP, thanks!

    I'll take a look later in HDRP and DXR how to get a matte out for it in case we want to replace or grade it further in post....
     
    wetcircuit likes this.
  7. newguy123

    newguy123

    Joined:
    Aug 22, 2018
    Posts:
    1,248
    Old thread, but thought I'd add that I've tested it with HDRP and DXR, and it works here also
     
  8. newguy123

    newguy123

    Joined:
    Aug 22, 2018
    Posts:
    1,248
    How would I go about doing this, but having video as a backplate?
     
  9. vladala

    vladala

    Unity Technologies

    Joined:
    Mar 3, 2017
    Posts:
    189
    Hey,

    If you got an image working, the jump to a video is not too far:
    You can instantiate the VideoPlayer component (with the video clip) in a scene and make it output to a renderTexture that you bind to the material as a base map.

    Bear in mind that if you want to record the output, you run into timing issues with the video. We can talk about the workarounds when you get there :)
     
  10. newguy123

    newguy123

    Joined:
    Aug 22, 2018
    Posts:
    1,248