NatCorder - Video Recording API

Quick test with newest version of Unity 2019.2.3f1, alas, does not solve Metal color problem, nor the failed to restart properly.

 

Hm this is weird because we explicitly fixed this JNI error and there haven't been reports of it since. Did you freshly download NatCorder 1.6.1 from the Asset Store before running this test?

 

I'm going to implement our custom readback solution on macOS instead of relying on Unity's. I'm still working on the editor freezing; it hasn't been fixed yet.

 

I use simple scpirt and my video recorging without sound

Code (CSharp):

1. clock = new RealtimeClock();
2.         _videoRecorder = new MP4Recorder(720,1280,30,0,0,OnRecordStop);
3.         _cameraInput = new CameraInput(_videoRecorder,_clock,Camera.main);
4.         _audioInput = new AudioInput(_videoRecorder,_clock,Camera.main.GetComponent<AudioListener>());

Platform - PC, trying build and check on android
When i start my game(editor), i recording and have mp4 file. I Off my game(editor) and want start again, my editor freez and only go to task manager

 

Don't create an `AudioInput` if you don't specify a sample rate and channel count. This is undefined behaviour, and can cause a crash.

 

if not creating AudioInput, i will have audio recording?? Or you can give me advice me about sample rate and channel count?

 

where i can find required sample rate and channel count for my project?

 

See Unity's AudioSettings class, and how we use it in the ReplayCam example.

 

somewhere i made mistake. I dont have sound in mp4 file and after restart game my editor freezing forewer

Code (CSharp):

1.  _clock = new RealtimeClock();
2.         _videoRecorder = new MP4Recorder(720,1280,30,AudioSettings.outputSampleRate,(int) AudioSettings.speakerMode,OnRecordStop);
3.         _cameraInput = new CameraInput(_videoRecorder,_clock,Camera.main);
4.         _audioInput = new AudioInput(_videoRecorder,_clock,Camera.main.GetComponent<AudioListener>());

also i tryed that and i also dont have sound, and editor freezing too

Code (CSharp):

1.  
2. _clock = new RealtimeClock();
3.         _videoRecorder = new MP4Recorder(720,1280,30,0,0,OnRecordStop);
4.         _cameraInput = new CameraInput(_videoRecorder,_clock,Camera.main);
5.         //_audioInput = new AudioInput(_videoRecorder,_clock,Camera.main.GetComponent<AudioListener>());
6.  

 

The editor freezing is a known issue; I'm still looking for a fix.

 

ok, thank you, what about sound in my video?

 

Is there sound in the game? Your code looks good.

 

yes. Now i open empty project, import plugin, and build ReplayCam scene. When i start on device my screen was full white i cant see real world and i made this -> http://prntscr.com/ozobr5 and sound doesn`t exist in video

 

if recordMicrophone == true i have sound. If recordMicrophone == false and i have play back audio source i dont have sound in video

 

In this apk sound play on awake, Try to record and check sound in video file
https://drive.google.com/open?id=1BKRPqhxFFFb3zDnMxyHWIYjU-Z6xXp3a

 

I'm really glad to see that support for RenderTextureInput was added back in!

However I am having a fatal crash on iOS 13.1

Code (CSharp):

1. 2019-08-30 12:58:52.436147-0700 arkitapp[1234:123456] NatCorder: Prepared MP4 video encoder at resolution 1280x720@30Hz with average bitrate 5909760 and keyframe interval 3s
2. 2019-08-30 12:58:52.442397-0700 arkitapp[1234:123456] -[AGXA11FamilyCommandBuffer blitCommandEncoder], line 128: error 'A command encoder is already encoding to this command buffer'
3. -[AGXA11FamilyCommandBuffer blitCommandEncoder]:128: failed assertion `A command encoder is already encoding to this command buffer'

If I comment out lines 58 and 59 of RenderTextureInput.cs it works:

Code (CSharp):

1. public void CommitFrame (RenderTexture framebuffer) {
2.             if (Application.platform == RuntimePlatform.Android)
3.                 CommitAndroid(framebuffer);
4.             //else if (Application.platform == RuntimePlatform.IPhonePlayer)
5.             //    CommitiOS(framebuffer);
6.             else if (SystemInfo.supportsAsyncGPUReadback)
7.                 CommitAsync(framebuffer);
8.             else
9.                 CommitSync(framebuffer);
10.         }

But I assume that this is skipping over the new fast iOS feature. Not critical, but would be very nice to have.

 

With Natcorder and Natmic updated, you can no longer use old code.
If you're using Unity's built-in recording chords, you'll still hear poor sound quality.
I want to know how I can re-record using Natcorder and Natmic assets.

 

Hello,

Im using NatCorder to combine two different videos. By playing both videos one after the other and using NATCORDER to record both playbacks (voice and video) the result is one video which is a combination of both.

It works except after playing the first video, it takes maybe a second to start playing the second video, during that time NATCORDER is still recording, so the final video ends up with a blank spot between the videos.

Is there a way to PAUSE the NATCORDER recording after the first video has ended, and then resume recording after the second video starts playing, then end recording after the second has completed.

So my question is how to make NATCORDER do a pause and resume recording (video and audio). Im using Android and IOS.

Thanks

 

If the screen is white, then check the camera permissions. Also, the ReplayCam example will replace whatever clip you have with the microphone clip. Write your own script to record the audio source as-is, instead of using the ReplayCam example since it works differently.

 

I'll check this out. Thanks for reporting.

 

What old code are you referring to? The NatMicCorder demo is up to date.

 

See the "Pausing Recording" section of this article.

 

I fixed it. But problem with sound issue is still. Do you watch my apk?

 

We bougth your assets for recording in our game. We think we can rely on it. Can you check please

 

I haven't had time to test your APK. Can you describe the sound issue you are facing?

 

I made build reply scene, disable mic recording, change Audio source to Play on awake and add audio clip. When i start game i have sound. When i record video, i dont have sound in my video clip. I use your code from sample scene

 

Hello,

I copied the Replay Example into my own project, and record using the StartRecording/StopRecording function, however when recorded video is played back the video is rotated and plays sideways, do you know how to make it straight?

I also noticed that in your example video is being recorded from a RawImage, while mine is being recorded from regular texture.

Also with your example its being played back using HandHeld.PlayFullScreen, while mine is being played back using a differnet player UMP (Universal Movie Player).

I dont know if any of those are a factor that causes the video to be shown sideways. Seems no matter what i do i cannot fix the problem, i tried rotating/flipping/reversing the texture, but then either the recorded video is rotated/flipped/reversed in some other way, or the playback is rotated/flipped/reversed.

Thanks

 

did you have sound in your video if microphone is disable??

 

I use vuforia, in game my real book has sizes

after recording, my in video sizes was changed, squeezed

my Code: start recording

stop recording.

my Phone Samsung A30

 

I used the same code (StartRecording, StopRecording) from the ReplayCam, but i dont really understand what you mean, but seems the resulting recorded video when played back to the same texture it was recorded from is always sideways. I know the player isnt causing it to be sideways becuase i played a test video to the same texture and it plays fine, so i know its not the player that is causing it. So the only other possibilities is the recorder, or the WebCam. I dont think its the webcam because it looks correct while recording (the webcam is displayed live on the texture while recording), so it must be the recorder that is recording sideways for some reason. I tried so many things over several days to a week, but still the problem remains. Maybe be its the shader, or something else i dont know, im just using the standard shader/material on the texture.

The only difference is that ReplayCam example uses a RawImage, while im using a Texture, dont know if that has anything to do with it.

 

maybe you can help me... i have AR ap(vuforia), when my target is found i create game object. Inside this GO i have audio source. In editor\andriod build i have sound in game, but when i record my video, i dont have sound in .mp4 and i also use scripts from ReplayCam

 

I dont know if there is audio because im still trying to get the video to record properly (its recording sideways), but i will check for audio in my next build and let you know if it works.

 

This is my point. The ReplayCam code will replace your audio clip with the microphone clip and record that. Write your own code to ensure that this doesn't happen.

EDIT: Can you share your recording code?

 

Does your project use any plugins that might affect how game cameras are rendered? Can you share a screenshot? You might be seeing WebCamTexture's rotation/flip. We have a script in ReplayCam that rotates the webcamtexture to be upright.

The example records a game camera. The game camera just happens to be 'looking at' a RawImage.

 

Apparently Vuforia modifies the game camera, preventing the aspect ratio from being correct. Try to record at a resolution that has the same aspect ratio as the screen:

Code (CSharp):

1. width = 1920;
2. height = (int)((float)Screen.height / Screen.width * width);

 

I tried and the audio does not get recorded! I will try building the example and see if that works

 

Hello,

I have problem where the recorded video when played back is sideways. Im using the ReplayCam example that records from a RawImage, and sets up the aspect ratio using the AspectRatioFitter component.

The problem is that recording from a regular texture and not a UI element with a RawImage attached. SO I cant use the AspectRatioFitter since that only works with a canvas, and im not using that im using a regulat old styled texture.

Do you know how i can get a proper aspect ratio without using AspectRatioFitter. Maybe this is why the recorded video is reversed??

Thanks

 

sorry, I found out on Github. I'll try it!

 

problems

 

Hello Guys,

After the latest Natcorder update 1.6.1, I am seeing a crash every time I record video with in-game audio in my android device Xiomi Redmi Note 3. The app crashes immediately after StopRecording(). I tried the same app on a different device like Poco f1 and iPhone 5S and it is working fine there. But specifically it is crashing every time on Xiomi Redmi Note 3. My code is as below and records in-game audio and three cameras outputs.

Code (CSharp):

1. private CameraInput cameraInput;
2. private IMediaRecorder videoRecorder;
3. private IClock recordingClock;
4. private AudioInput audioInput;
5. private AudioSource MicrophoneSource;
6. private AudioListener AudioListenerSource;
7.  
8. public Camera MainCamera; //Perspective Camera Depth 0
9. public Camera UICamera; //Orthographic Camera Depth 2
10. public Camera BackgroundCamera; //Orthographic Depth -1
11.  
12. private void StartRecording()
13. {
14.     Debug.Log("Setting up recorder...");
15.     // Create recording configurations
16.     var width = Screen.width;
17.     var height = Screen.height;
18.     var framerate = 30;
19.     // Create a recording clock for generating timestamps
20.     // Start recording
21.     recordingClock = new RealtimeClock();
22.     videoRecorder = new MP4Recorder(
23.         width,
24.         height,
25.         framerate,
26.         AudioSettings.outputSampleRate,
27.         (int)AudioSettings.speakerMode,
28.         OnRecordingStopped
29.     );
30.     // Create recording inputs
31.     cameraInput = new CameraInput(videoRecorder, recordingClock, BackgroundCamera, MainCamera, UICamera);
32.     audioInput = new AudioInput(videoRecorder, recordingClock, AudioListenerSource);
33. }
34.  
35. private void StopRecording() {
36.     audioInput.Dispose();
37.     cameraInput.Dispose();
38.     videoRecorder.Dispose();
39. }

The crash logs are attached with this post.

Note that the recording use to run as expected in the older version of Natcorder asset 1.6, but since the recent update, it crashes in this specific device (and maybe more but I have just tested in the mentioned devices).

Is anyone else experiencing this? Could you guys make out the reason behind the crash from the logs?

 

You'll need to manually orient your texture before you record it. We do something similar to display the WebCamTexture upright in the example scenes.

 

Your recording resolution is too high, and your height is an odd number. Try aspect scaling with respect to the height instead of width, and make sure that the numbers you have are even numbers.

 

Sorry for the late response. Are you able to reproduce this crash if you don't record audio? To test this, pass 0 for sample rate and channel count in the MP4Recorder constructor, and comment out the audio input line.

 

Hi Lanre,

Yes, without recording in-game audio, the app doesn't crash in the said device and all is working as expected.

 

Lanre, have you found a solution to recordings causing the editor to hang yet? If it helps your investigation, I noticed that a code recompile due to an edited script will also cause it to hang after a video is recorded

 

Is there any fix yet on the corrupted videos when recording with audio or the editor crashing when recording in it? It's already been multiple weeks since this problems were identified and still there is no response or fix for this, which greatly disturbs the workflow when doing tests and forces us to remove the sharing videos functionality from our game until there is some solution to these issues.

 

UI recording in canvas spaсe overlay is it real? in future?

 

I have the same problem。

 

Hi, I used NatCord and successed in IOS and one device on Android 7, but failed on other devices Android 8 +, Attached log.txt.
mp4 is saved correctly but all BLACK. any advices?

 

Same problem, editor hangs on the first recompile or play after a video has been recorded.

This is on Unity 2019.2.3f1 in Windows.