NatCorder - Video Recording API

How to record the whole screen without using the second camera and not using the render texture with UI? The second camera increases the drawing calls by 2 times.

It is on Android with resolution 640*360. I need full screen with this resolution


How change default path to a video on my path?
Can I get video in byte array without save to a disk?

Also falls a lot fps. With 24 to 10
Disabled

Enabled

 

Hey there. No it doesn't. But there are packages on the Asset Store that advertise GIF playback.

 

I'm confused. Why not just record your primary game camera? You don't need to create a second camera.

 

So I like how Nat* seems to be expanding to cover all camera recording/sharing needs - will gif playback / loading be also on the roadmap?

 

The main camera only records part of the low resolution screen
What about others question?

 

No, not GIF textures. There are already solutions for this on the Asset Store, so we'd rather not bother with our own implementation.

 

If you are trying to record multiple game cameras, you would need to write a custom recorder to do this. Here is a starting point for doing that.

You can't. Instead, use the System.IO.File functions to move the file to your desired directory.

No, NatCorder does not support recording to a memory stream. It records directly to the file system.

We are looking into improving recording performance in the next minor update. That being said, your app already seems to be bottlenecked before adding recording.

 

I tried Everyplay plugin and got 16-18 fps

 

Good to know. As I mentioned, we are working on improving recording performance.

 

Hi Lanre, I'm trying to use your audio API, I've added the following to the video recorder:

Code (CSharp):

1.         [SerializeField] Camera _camera;
2.  
3.         [SerializeField] AudioSource _audioSource;
4.  
5.         [Header("Recording")]
6.         public Container container = Container.MP4;
7.  
8.         private CameraRecorder videoRecorder;
9.         private AudioRecorder audioRecorder;
10.  
11.         public static string _videoPath;
12.         public static event Action<string> OnVideoRecorded;
13.  
14.         public void StartRecording()
15.         {
16.             _videoPath = null;
17.  
18.             var audioFormat = new AudioFormat(AudioSettings.outputSampleRate, (int)AudioSettings.speakerMode);
19.  
20.             var width = Screen.width / 2;
21.             var height = Screen.height / 2;
22.  
23.             var framerate = container == Container.GIF ? 10 : 30;
24.             var videoFormat = new VideoFormat(width, (int)height, framerate);
25.  
26.             NatCorder.StartRecording(container, videoFormat, audioFormat, OnShare);
27.  
28.             videoRecorder = CameraRecorder.Create(_camera);
29.             audioRecorder = _audioSource.gameObject.AddComponent<AudioRecorder>();
30.         }
31.  
32.         public void StopRecording(string albumName)
33.         {
34.             audioRecorder.Dispose();
35.             videoRecorder.Dispose();
36.             NatCorder.StopRecording();
37.         }

However every time audio is triggered I get a null reference error NullReferenceException: Object reference not set to an instance of an object at NatCorderU.Core.Recorders.AudioRecorder.OnAudioFilterRead (System.Single[] data, Int32 channels) [0x00008] in #######\Assets\NatCorder\Plugins\Managed\Recorders\AudioRecorder.cs:78

Am I missing anything in the setup of this? Thanks.

 

You have to create the AudioRecorder using `AudioRecorder.Create`, not by using `AddComponent`.

 

I get black screen on ios, Iphone 5.On Mac recording normal video. Multithread enabled and disabled

 

Can you email me the logs from Xcode in a .txt file? If you're running on an iPhone 5, then your app is probably using OpenGL ES.

 

Thanks, I've got it recording but there's a lot of crackling in the audio, I have the sample rate at 48000 so it shouldn't be that. My sounds are all normalized but if I lower amplitude it helps a bit however when I get multiple sounds together it's pretty bad. Any ideas?

 

You might need to reduce the volume on the AudioSource. Crackling on higher amplitudes usually indicates clipping. NatCorder doesn't modify the audio data; it copies it verbatim from Unity.

 

Yeah that's done it, strange that it wasn't clipping during play but doesn't matter now thanks.

 

Well, there are also solutions for video/camera on the asset store, as well but they are inferior in ways that caused you to create Nat*?

 

Yes, that's correct. But GIF playback is not something we are interested in.

 

How do you have AR objects from OpenCVforUnity show in a natcam video recording? The AR objects are on an AR Camera, while the video is from an orthographic main camera

 

Sounds like you want to record multiple cameras simultaneously. Check out the MultiCameraRecorder script as a starting point.

 

Hello. I'm just also writing to report I'm having the same OSX issue as reported by other users.

Code (CSharp):

1. DllNotFoundException: NatCorder
2. NatCorderU.Core.Platforms.NatCorderOSX..ctor () (at Assets/NatCorder/Plugins/Managed/Platforms/NatCorderOSX.cs:42)

I'm on Unity 2018.3 beta, macOS Mojave 10.14.1.

 

I'll be submitting an update tomorrow with the fix for this. If you'd rather not wait, email me with your invoice number.

 

Builds below Android API level 18 are not possible.
However, our app has already been commercialized. And we are using API Level 16 minimum.
If the API level is raised, the previous user can not execute.
Make it possible to build under API level 18, and below API level 18 we want to implement the feature so that it is not available.
Is it possible?

 

Unfortunately we can't make the minimum any lower than API level 18. NatCorder relies on Android functions that were introduced in API level 18.

 

We will implement it so that we can use NatCorder only at API Level 18 or higher.
Can I choose to build it?

 

I'm not sure what you're asking. How do you mean "can you choose to build it"?

 

I hope that there is no limit to the build, and I will implement it myself to avoid using NatCorder.

 

I'm not sure what "the build" is. Can you clarify?

 

Yeah.
An Android build.

 

As far as I can tell, you can't remove the minimum API requirement for an Android library. Hence, it isn't possible to build to a lower target when a library has a higher requirement. This is a limitation of the Android build system.

 

Hello, I have a crash when I'm recording and I send the application to the background on Android devices.

 

Hi there. I responded to your email. But I'll post it here for anyone else to see:

This is expected behaviour. You must end recording before the app loses focus; not doing so results in undefined behaviour. This is an OS restriction (because any new app that has primary focus might need exclusive access to the hardware codecs).

 

Yes, I stop the recording when I send the application to the background, in IOS it behaves well, but in android is where the problems occur. this is what Im using to stop recording

onAplicationPause (bool a) {
if (recording && a) {
StopRecording ();
}
}

 

Can you upload the full logs from logcat in a .txt file?

 

Hi Lanre,

I'm having exactly the same problem as reported by FlashyGoblin. You said there's some code signing error going on.
I just shoot you an email with my invoice.
Could you please help with that?

Regards,
Andre Teves

 

I responded to your email.

 

finding problems with the system of gif in vuforia in the version of unity 2018.2.18 is not recording the screen, it remains black in the replay and then it comes out with an error that is this:

My e-mail is miguel.bohorquez890@gmail.com pls help me

 

Can you share the full logs from logcat in a .txt file? Also, what does your recording code look like?

 

I just put the ARcamera and the image but when compiling the modeling it is behind the preview and when it finishes recording it fails and the message of the previous sent image

Maybe I'm doing something wrong, could you explain or send a simple example of vuforia and natcorder with gif recording? I'm a novice developer yet, thanks.

 

Hi Lanre, sorry to pester you again, the video and audio recorded on android are fine yet for some reason on iOS the videos run fine but the audio is 2x speed, I can't understand what's causing it, any idea what might be wrong? Code below:

Code (CSharp):

1.                 var audioFormat = new AudioFormat(48000, (int)AudioSettings.speakerMode);
2.  
3.                 var width = Screen.width / 2;
4.                 var height = Screen.height / 2;
5.  
6.                 var framerate = 30;
7.                 var videoFormat = new VideoFormat(width, (int)height, framerate);
8.  
9.                 NatCorder.StartRecording(Container.MP4, videoFormat, audioFormat, OnShare);
10.  
11.                 videoRecorder = CameraRecorder.Create(_camera);
12.                 audioRecorder = AudioRecorder.Create(AudioManager.instance.GetComponent<AudioSource>(), AudioManager.mute);

 

There isn't a Vuforia example. But you should simply create a CameraRecorder to record the AR game camera (just like the ReplayCam example does to record the main camera).

 

Unlike the bitrate in the VideoFormat which denotes the output bitrate, the bitrate in AudioFormat denotes the input bitrate (NatCorder fixes the audio output bitrate to 64kHz I believe). Since you are recording Unity audio, the bitrate should be that of Unity's audio engine (AudioSettings.outputSampleRate).

 

I'm recording mp4 for an ARKit project with NatCorder. Normally my app just takes up to about 300MB memory (view in XCode), but after I call StartRecording the memory usage will soon boost to 1.4GB within 10 seconds and the app crashes (on iOS 12).

I've commented out audio committing codes and got the same result. Here's my code in LateUpdate:

Code (CSharp):

1.  
2. void LateUpdate() {
3.         if (NatCorder.IsRecording) {
4.             var frame = NatCorder.AcquireFrame();
5.  
6.             for (int i = 0; i < cameras.Length; i++) {
7.                 cameras[i].targetTexture = frame;
8.                 cameras[i].Render();
9.                 cameras [i].targetTexture = null;
10.             }
11.             NatCorder.CommitFrame(frame, clock.CurrentTimestamp);
12.         }
13.     }
14.  

2018-12-04 12:51:03.211403+0800 marbles[2709:955958] NatCorder: Prepared MP4 video encoder at resolution 750x1334@30Hz with average bitrate 5909759 and keyframe interval 3s

I'm using NatCorder 1.3f2 and Unity 2017.4. Have I missed something? Please help...


UPDATE: If I start the app in AR mode the memory will be consumed fast, but in non-AR mode everything seems Ok. Maybe something in Unity ARKit plugin is conflicting with NatCorder

 

What is your app's framerate? If it's 60FPS, then you're committing frames to be recorded at 60FPS. It sounds that this is not feasible when using AR on your device, so only commit frames every other frame (creating a 30FPS video).

 

Hello. when using NatCorder on Android , NatCorder.StartRecording(...) never called. And after ~10 srconds app crashes. On IOS and in editor it works awesome. What im missing ?
Thakns.
Here the code im using

Code (CSharp):

1.  
2. public void pressVideoButton(){
3.         Debug.Log("Pressed video button");
4.         if (!NatCorder.IsRecording){
5.             Debug.Log("Started recording");
6.             StartRecording();
7.             videoButtonBig.GetComponent<Image>().color = Color.red;
8.         }else if (NatCorder.IsRecording){
9.             Debug.Log("stopping recording");
10.             StopRecording();
11.             videoButtonBig.GetComponent<Image>().color = Color.white;
12.         }
13.     }
14.     void OnReplay(string path)
15.     {
16.         Debug.Log("Saved recording to: " + path);
17.         // Playback the video
18. #if UNITY_IOS
19.         //Handheld.PlayFullScreenMovie("file://" + path);
20.         NatShare.SaveToCameraRoll(path);
21. #elif UNITY_ANDROID
22.         //Handheld.PlayFullScreenMovie(path);
23.         Debug.Log(path);
24.         NatShare.SaveToCameraRoll(path);
25. #endif
26.     }
27.     void StartRecording()
28.     {
29.         Debug.Log("start recording method");
30.         // Start recording
31.         format = new VideoFormat(960, 540);
32.         NatCorder.StartRecording(Container.MP4, format, AudioFormat.Unity, OnReplay);
33.         // Create a camera recorder to record the main camera
34.         clock = new RealtimeClock();
35.         videoRecorder = CameraRecorder.Create(mainCamera, clock);
36.         audioRecorder = AudioRecorder.Create(sourceAudio);
37.     }
38.  
39.     void StopRecording()
40.     {
41.         Debug.Log("stop recording method");
42.         //Destroy the camera recorder
43.         videoRecorder.Dispose();
44.         audioRecorder.Dispose();
45.         // Stop recording
46.         NatCorder.StopRecording();
47.  
48.     }
49.  
50.     void OnAudioFilterRead(float[] data, int channels)
51.     {
52.         // Check that we are recording
53.         if (NatCorder.IsRecording)
54.         {
55.             NatCorder.CommitSamples(data, clock.CurrentTimestamp);
56.         }
57.     }

 

I responded to your email. Let's continue the conversation over email.

 

How to record with UI screen space - overlay?

i got some error when running record video on osx editor in macOS Mojave but running well on ios device..

DllNotFoundException: NatCorder
NatCorderU.Core.Platforms.NatCorderOSX..ctor () (at Assets/NatCorder/Managed/Platforms/NatCorderOSX.cs:42)
NatCorderU.Core.NatCorder..cctor () (at Assets/NatCorder/Managed/NatCorder.cs:113)
Rethrow as TypeInitializationException: An exception was thrown by the type initializer for NatCorderU.Core.NatCorder
NatCorderU.Examples.ReplayCam.StartRecording () (at Assets/NatCorder/Examples/ReplayCam/ReplayCam.cs:55)
UnityEngine.Events.InvokableCall.Invoke () (at /Users/builduser/buildslave/unity/build/Runtime/Export/UnityEvent.cs:165)
UnityEngine.Events.UnityEvent.Invoke () (at /Users/builduser/buildslave/unity/build/Runtime/Export/UnityEvent_0.cs:58)
UnityEngine.UI.Button.Press () (at /Users/builduser/buildslave/unity/build/Extensions/guisystem/UnityEngine.UI/UI/Core/Button.cs:36)
UnityEngine.UI.Button.OnPointerClick (UnityEngine.EventSystems.PointerEventData eventData) (at /Users/builduser/buildslave/unity/build/Extensions/guisystem/UnityEngine.UI/UI/Core/Button.cs:45)
UnityEngine.EventSystems.ExecuteEvents.Execute (IPointerClickHandler handler, UnityEngine.EventSystems.BaseEventData eventData) (at /Users/builduser/buildslave/unity/build/Extensions/guisystem/UnityEngine.UI/EventSystem/ExecuteEvents.cs:50)
UnityEngine.EventSystems.ExecuteEvents.Execute[IPointerClickHandler] (UnityEngine.GameObject target, UnityEngine.EventSystems.BaseEventData eventData, UnityEngine.EventSystems.EventFunction`1 functor) (at /Users/builduser/buildslave/unity/build/Extensions/guisystem/UnityEngine.UI/EventSystem/ExecuteEvents.cs:261)
UnityEngine.EventSystems.EventSystem:Update()

How to fix this issue?

 

This is not possible. Please look through the README for more info on this. It is a limitation from Unity Engine.

Shoot me an email with your invoice number and I'll share an updated build with the fix.

 

Hi just to follow up on this, I was reading this and it seems as though you could add a check that the API level is 18+ other wise do nothing (or other fallback). I imagine what nDream is asking for and what I would find useful is for the Natcorder manifest to have at lower minimum API level, but have a fallback or do nothing. This would allow me to do a check and if the version is 18+ I'll use natcorder, if lower I can then call a different implementation that will work. This would be useful as it means I have to manage less APKs when distributing.

This may not be possible, but I thought I'd mention in case it is of any use.

 

Unfortunately, we don't have this option. We can't build the AAR without specifying the minimum as 18 because the functions we use were only introduced in 18.