[RELEASED] VR Panorama - render 360 stereo videos

I opened up the unity hdrp template in 2020.2.1f1. Took the camera in the scene and added the vr capture script to it and its doing that ring around every image in the panorama. Any idea what post processing, or just anything that needs to be hidden for that to not happen? Something in the HDRP default settings maybe that needs to be checked or unchecked. Just trying to figure out what works first before trying to use this in latest unity 2020 and hdrp.

 

You just have to turn off automatic exposure that is enabled by default (by creating a global volume and adding override for Exposure by sitting it to manual mode).

 

I ran the StillShotFix [https://forum.unity.com/threads/rel...360-stereo-videos.336086/page-32#post-5778799] and the original error is gone but I have this error now, and no image output:



Panorama Captured
UnityEngine.MonoBehaviourrint (object)
VRPanorama.VRCapture:LateUpdate () (at Assets/VRPanorama/VRCapture.cs:799)

 

@olix4242 Adding my render settings. The images appear to be rendering just not being put in the render folder. Would they be in temp somewhere?

 

Any options for HVEC / h.265 encoding so we can use recordings in 8k 60fps? The options are there, but no way to playback the output. I believe h.264 doesn't support higher resolutions/fps

 

Usage of a folder name is related to Assetst folder in Unity. If you need a full folder name , than you have to use "Use Custom Path" and insert a full folder path. Otherwise, you have to use only a name without brackets.

 

h.264 can output 8k videos, but they aren't readable by all players. If you need an 8k, I'm suggesting to use image sequence and then export from video editing software.
(btw, I'm not suggesting you to use h.265 files for any other thing than final export. Due to it's file structure it mostly impossible to edit later.

 

Hi there. 1st of all: Great Asset ! Unfortunately, i have an issue within a unity 2020.2.1f1 . (HDRP Project)
After fixing some issues (Changing unityengine.vr into unityengine.xr in the script) i was able to insert the camera.

Unfortunatetly, the taken screenshots are “white” or grey and i get errors in the console:

Destroying object “TempBuffer 25 4096×4096” is not allowed at this time.
UnityEngine.Objectestroy (UnityEngine.Object)
VRPanorama.VRCapture:LateUpdate () (at Assets/VRPanorama/VRCapture.cs:729)

As far is i know, this error shouldn´t effect the saved image, but maybe it has sth. to do ?

Any idea what went wrong ?

 

I bought your plugin last year, but never had the time to use it, since I failed once (had tons of postprocessing effects on two layered cameras) anyhow, my question is: does it run today with URP? And if not, what are my alternatives to capture a 360 video of my URP scene?

 

Yes, it should work with URP.

 

Hi Oli - is there a way to increase Speed vs. Quality up to 64 to get Anti-Aliasing 8X??? We are now in 2021 and our GPUs are quite powerful - I would like to have best possible image quality...

 

I am trying to install the "VR Panorama Camera" in my project. I downloaded it and imported it, but it does not appear under the "Game Object" menu. In the console I get the following message:

"Assets\VRPanorama\VRCapture.cs(13,19): error CS0234: The type or namespace name 'VR' does not exist in the namespace 'UnityEngine' (are you missing an assembly reference?)"

So what does this mean and how will I be able to use the camera after installing it?

Thanks.

 

I found the fault, deleting the offending line.

 

Hello, I'm doing a video capture in animation capture mode and can't figure out how to get UI text to get recorded. I tried both world space and screen space, can't get it to work in either. Please help!

 

You shouild always use World space Canvas. Check that Layer orderings are correct. As long as you can see your canvas with your camera, it should work fine. Without having more info about your project this is all that a can suggest for a moment.

 

There are a number of issues:

1. The renderer is ignoring Camera Culling Masks
2. Renders are incredibly dark when using PNG or JPG when Post Processing is applied (It doesn't do a proper linear to gamma conversion)
3. Resume from frame doesn't always output frames

This is from Unity 2019.4.20f1

 

When doing reporting on issues, please let me know something more on your setups. Like if you are using standard or HDRP pipeline, what version of pipeline or post processing. Without that info I really cani help you.
-camera culling masks should be supported if correctly set on camera. If this isn't a case, please five me more info on your case.
-there is no any known issue about final images being darker than viewport. Have you tried turning off automatic exposure (or eye adaptation)?

 

Hello, as many ppl know unity recorder api for 360 stereo just dont works with HDRP correct or with RTX features. and stereo renders in HDRP looks like is just disable. last screen space effects like AO and reflections are just spoiled by the unity recorder stiching, so i want to do some questions before buy this asset .

1 - its works with last versions of HDRP ? ( 10 and uper from 2020.2)
2 - its works with 2021.2 ? ( i using it for my project cause its supports realtime enlight gi with HDRP )
3 - its realy rec in stereo? ( avpro for example use unity recorder i believe cause it have the same problem of unity recorder looks like stereo is disable in hdrp, unity offline render another asset, create distortions on stereo render with objects near camera and the stereo looks really bad on hdrp )
4 - its support raytracing for 360 mono and stereo?
5 - its fast like unity recorder ?
thank you

 

i buy you asset cause i really need a working render for 360 stereoscopic, and i got same error on a empty project on 2020.2 and on my corrent project on 2021.2 its the same error as you can see on pictures. plz help

 

can you help me with that ? i having this same error

 

eh i really need help with this error , cause i am not a programer i am a 3d animator , i just want use the
asset, i try edit the script to delete the word "VR" and this generate more errors.. HELP!

 

You just have to delete whole line (not just a word VR).

 

1 - its works with last versions of HDRP ? ( 10 and uper from 2020.2) - YES on 10. Newer versions weren't tested. As HDRP is still in experimental phase, I can't guarantee that it works with all systems and all versions.
2 - its works with 2021.2 ? - NOT TESTED - I'm never adding a support for Alpha versions of Unity. Especially not for Alpha versions with HDRP. They can be incredibly buggy, and usually, if there are problems, they get fixed with time on Unity side.
3 - its realy rec in stereo? - YES IT IS.
4 - its support raytracing for 360 mono and stereo? - YES (but without any guarantees). It also depends much on a hardware that you are using. RTX can use big amounts of VRAM even without VR panorama - and rendering high res videos can pretty fast 'eat' all your memory. So this really depends on complexity of your scene, resolution, features that are enabled and so on. When you render into a 360 image, it is like rendering onto a screen 6 to 12 times more. As before - RTX in unity is still experimental feature, so I can't give you a guaranty on this.
5 - its fast like unity recorder ? In standard pipeline it is approximately similar (sometimes it is slower sometimes even faster) - but this depends on many factors - like quality settings, rendering format, type of panorama etc. On HDRP, we can't really compare it.

 

with your help I was able to delete the line and the asset ran on my project but with this error msg


after that, i started having errors with stitching i'm posting a mono panorama generated with the unity recorder to follow as an example. ( unity recorder cant generate correct stereoscopic with hdrp and give a lot of distortions with screen space effects , and seams but the stitching looks correct
now your asset , stitching looks tottaly diferent and adobe premiere just dont recognite that .
to get this result i was forced to disable all color post effects cause it generate luminance discrepances.
your asset is not only incompatble with automatic exposure, any color correction post effect will generate luminance discrepances like that .

using its HQ stereo stitching, the buildings are cut and continue to generate erroneous results.
even with the color correction effects turned off, the renders of the asset continue to generate a certain discrepancy in luminosity,

 

his HQ stitching is incompatible with volumetric fog. as you can see at the bottom of the panorama where there are discrepancies compared to the top. which doesn’t happen with normal stitching,


HQ stitching

normal stitching

 

I really hope that these problems are being generated by the error I posted at the beginning and that they can be corrected. with your help, otherwise, your asset is useless to me because I need to generate stereo panoramas with HDRP and all its visual resources which is not happening, to use standard legacy pipeline the unity recorder works perfectly for me.

 

all this tests was made with unity 2020.2 and HDRP 10 . i migrate my project from 2021 to 2020.2 just to made this tests .

 

I think that you have some problems in setting up correctly vr panorama. Are you using some custom scripts for camera movement? If you are, they shouldn't be attached to camera that has VRCapture component. If you want to use them still, be sure to make another camera, apply movement script to that one, and add a camera with VRCapture component as a child.

 

i dont use anyother custom script for camera movement the camera movement is a fbx animation made in 3dsmax

 

VR panorama doesn't support automatic exposure (as stated in manual). You have to set it to manual exposure always. Also, it's not enough to disable component for exposure, because, in HDRP, it will simply default to automatic exposure. Be sure to create a local volume attached to a camera with all the effects set correctly and exposure set to manual.

 

How do you trigger that animation?

 

my camera

 

the animation is playing in timeline using virtual cams ,

 

exposure is manual, i see on forum and have sure its manual, and like i said on post your asset dont like any color post processing so i put all it off, but as you can see i post a result with that on whic is tottaly dark image

 

You are using cinemachine brain, and it takes control over 369 stitching. As said before, create a new camera with VRCapture component and set it as child of this camera.

 

with all due respect to your work, if you don't know a solution to the problem I'm having with your asset, I would like to have refund. thank you.

 

ok i will do and post the results .

 

Please, be kind and read previous message.

 

i'm being kind. and it's working now that I removed the cinemachine brain (this should be in the asset documentation) I still have problems with luminance discrepancy when I use color correction post effects (any tips on how to get around this?), but for the simple fact to be working ok with volumetric fog, screen space effects and generating seamless sttiching and with correct stereoscopy, for me this is already great.

 

your asset is incompatible with , "color adjustment " effect " shadow , midtones highlights " as i can test , but i believe it will generate luminace discrepances with any effect override deals with color correction, but as i already said i am ok wth that i can do post production in adobe premiere. and no, no need for refund, i tested all assets and your asset is unique working ok with hdrp at production level .

 

ahh one more thing your asset documentation dont explain the function "disable vr tracking " plx explain what it does.
thank you

 

Hi there!

I'm running into an issue where the VRAM usage goes through the roof as soon I start rendering, even on an empty scene. I can go up to 4k x 4k with quality set to 24, but anything above that crashes.
The error I'm getting is "Thread group count is above the maximum allowed limit. Maximum allowed thread group count is 65535." It's a 2019.1 HDRP project, I'm using an RTX 3080 with 10gb vram.
Any idea how I could get the quality settings higher than this? My only thought was to try an SLI setup, am I right to think if I would hook up a 1080 and a 1080ti with an SLI bridge that would allow me to use the sum of their VRAM?

Thanks!

 

It was just a safe option made for older versions of Unity (to avoid triggering of a VR headset while rendering).

 

SLI won't help you. SLI doesn't sum any available memory. And I actually think that this is related to a memory leaks in HDRP - and if this is a case, having more VRAM won't help you much.
Apparently, this is a known issue in HDRP when rendering large screen sizes (not actually related to VRPanorama). A kind of a memory leak related to compute shaders (and VR panorama doesn't use them). I assume this comes from some image effects or some internal HDRP compute shader procedures.
https://forum.unity.com/threads/thr...m-allowed-thread-group-count-is-65535.828420/

Things that I can suggest you:
-Don't use more than 16X quality when rendering larger resolutions. Higher Quality setting is more important on lower resolution 360 than it is on higher res rendering. 16X will give you a supersampling of 2X.
-My personal suggestion is to switch to HDRP 10 (and unity 2020LTS) as soon as possible.. Older versions of HDRP have too many memory leaks all over the place and many of those leaks were fixed in HDRP10. It is much more stable and more production ready.

 

Switching to the latest version helped a lot, I even managed to get 32x quality and 8k renders most of the time. Thank you!

 

Hello,
I have issues with the shadows of some trees, and only in a few frame.
It also didn't happen on all cameras every time.
There is two exemple :



Do you have any idea where this might come from?


My export settings :
-Resolution : 3840x2160
-FPS : 30
-Speed vs. Quality : 32
My pc config :
-Ram : 32go
-GPU : RTX 2080 Super
Unity :
-Unity 2019.4.23f1
-HDRP 7.5.3

Thanks

 

Hi Jordan,
It's impossible to know really why this happens. From my experience, this used to happen when going out of free VRAM, with legacy pipeline. On the other side, I see that you should have pretty enough VRAM for the settings that you use. But, nevertheless, I also know that older versions of HDRP (lower than HDRP10) had some pretty big leaks in VRAM when rendering to multiple cameras, so you still may have high VRAM usage. My best suggestion is to try rendering with quality of 16 -24 (is should be more than enough) and see if those shadow errors persist. And a most important suggestion is to switch to HDRP10 (or 11) ASAP, as it bring fixes for memory leaks and are overall much more performant and less VRAM hungry.
tip: when rendering, start windows task manager, go to the performance tab, scroll down to GPU and look at your VRAM usage while rendering. If Dedicated GPU memory usage graph approaches it's top, then you simply don't have enough memory. Solution is to drop down quality VS performance slider until you reach a sweet spot. (be aware that a quality of 32 requires 4 times more VRAM than 16).

 

Hi @olix4242 ,

I just updated your plugin with the last version and i've a problem with my scene in HDRP.
After 10 capture i've this message and unity crash.
Do you have an idea ?
Thanks.
Best regards.

Unity version : 2021.1.3f1

Clément

 

This is apparently a known long time bug in Unity. I suggest you to send a bug report directly to Unity.
https://issuetracker.unity3d.com/issues/unity-crashes-with-fatal-error-callback-registration-failed-kmaxcallback
(there is no any reason for this happening as a direct cause of a VR Panorama). Does it happen always or only in particular scene, particular cases? You might also try creating a new project in 2021.1.3f1 and check it there.

p. s. Also, an update of VR Panorama shouldn't be a cause of this issue. It has only some changes in shaders for better compatibility with HDRP and URP. Nothing that could cause something like that.