MediaPlayer8 - all-purpose, streaming & caching support

thefallengamesstudio · Apr 8, 2020

visionnaireMedia said: ↑

Thanks for your response.

I tried something to work around the problem.
So right now I activate the sphere where I have to apply the stream video and by default it is inactive, then I have the other sphere where I put any other content, by doing this I won't need to change the texture, but the problem persists.

As I start the scene and the streamSphere gets activated, the stream actually outputs video & sound, but then I deactivate it, then reactivate it and at that point, I can hear the sound, but no video.

The code I use when I need to activate is the following:

Code (CSharp):

streamSphere.SetActive(true);

if (mediaPlayer.Initialized) {

loadStreaming(streaming);

} else {

mediaPlayer.Initialize(delegate {

print("DONE init");

loadStreaming(streaming);

}, delegate (string str) {

print("ERROR init: " + str); // never seen this message

});

}

// loadStreaming function -----

void loadStreaming(string stream){

mediaPlayer.Load(stream, delegate (string str) {

print("STREAM load DONE: " + str);

mediaPlayer.NativeController.SetPlayWhenReady(true);

}, delegate (string str) {

print("STREAM load ERROR: " + str); // never seen this message

});

}

On the second time I run the previous code, I get the usual OPENGL NATIVE PLUGIN error, just as previous message.
The weird thing, tho, is that on the second run, I still get the size of the video, can hear the streamed sound, but no video.

Anything else I can try? Anything I should change in the code itself?
Click to expand...

Hey. I responded you on the email. Will post here when the cause will be found (to let other users know if they have a similar problem)

TwentyCents said: ↑

Hi,

Am currently using MP8 to Play 360 content and it works pretty well.
I would like to collect Player logs using this API (ControllerProxy.cs);

Code (CSharp):

public bool GetDebugInfo(ref string str)

{

if (_MediaPlayerFragment != null)

{

str = _MediaPlayerFragment.Call<string>("getDebugInfo");

Debug.Log("[ControllerProxy][GetDebugInfo]::Debug Info::" + str);

return true;

}

return false;

}

Unfortunatelly the 'str' variable is empty although Player is loaded and decoding the video.
Is there any recommendations to follow regarding the collections of Player logs ?

Thanks!
Click to expand...

Hey.
The debug info string there is currently only used in an unreleased variation of MP8.
The simple version of MP8 (the one released), doesn't write anything to that string. What info would you like to know?
I'm not sure it'll be possible to gather everything, but I'll try.

-- Lucian

ghasedak3411 · Nov 1, 2020

Hi, I want to convert surface view to texture in Unity, I saw this page and I ask you for help
https://forum.unity.com/threads/proper-way-of-updating-a-texture-outside-unity.439733/
Did you get the answer?
I want to use the native camera output in Unity, thank you for your help.

thefallengamesstudio · Nov 3, 2020

ghasedak3411 said: ↑

Hi, I want to convert surface view to texture in Unity, I saw this page and I ask you for help
https://forum.unity.com/threads/proper-way-of-updating-a-texture-outside-unity.439733/
Did you get the answer?
I want to use the native camera output in Unity, thank you for your help.
Click to expand...

Hey. I had to do it via a native C++ plugin, and only for Android. But I cannot share the sources.
But there may be better options out there, if you have the time to search. It's been a while since I've researched anything on this subject. Cheers!

-- Lucian

bharathrajad · Jan 13, 2021

Can you add rtsp/udp stream support ?

thefallengamesstudio · Jan 15, 2021

bharathrajad said: ↑

Can you add rtsp/udp stream support ?
Click to expand...

Hey. Probably in the future, but no I cannot provide an ETA

-- Lucian

thefallengamesstudio · Jul 29, 2021

FawnMarkus said: ↑

Hey thefallengamesstudio,

I'm currently using your MediaPlayer8 system in order to render a VR 4k stereoscopic 3D video on the Pico 2G4k since the Unity Video Player doesn't work very well with larger video files. MediaPlayer8 worked pretty fine in most cases in the past. However right now I encountered a problem, which I didn't manage to solve. I use a double sphere setup in my scene, so two spheres scaled up to 1000 with a material for each eye witch back facing activated. The texture the material renders is the same texture I assigned to the MediaPlayer8 component, the Target Texture property of the Simple Media Player 8 component to be specific. However no matter which import settings I use for the texture, I get a seam and a blurry image on the upper and lower part of the video. However when using Unity's video player and a render texture setup the video renders perfectly fine (except the performance issue, which is why I need an exo player alternative). Do you know what's going on there? I try to give as much information as possible about my setup:

The video I use is 3840 x 3840 pixels

The texture I use has: Texture Type: Default, Texture Shape: 2D, Generate Mip Maps: disabled, Wrap Mode: Clamp, Filter Mode: Trilinear, Non-Power of 2: None

As I said: No matter what I change here (inside the texture import settings), the result image stays the same. I assume that you use your own settings for the android texture and since you're assigning the android texture pointer to this texture, my settings get overidden. Does this make sense?

I used a frame of the video as a reference and assigned it to the material, so that only a stereoscopic 3D and 4k image is rendered instead of the video (no MediaPlayer8 involved here). The seam isn't there. However, if I activate Generate Mip Maps, the same effect happens. So maybe Mip Maps cause that problem in your texture? Sorry, if that sounds noobish

For testing purposes I also used Graphics.Blit from within the Media Player 8 Update in order to copy the result image into a render texture and assigned that render texture to my materials. Did work, the seam was gone, but with a huge decrease in performance... Which makes sense, since this copied a huge image from a texture to another texture each frame.

Some example images of how it looks inside the app on the device:

View attachment 896414

View attachment 896417

And here some example images of the test frame without the seam and without using MediaPlayer8:

View attachment 896423

View attachment 896426

I would be super grateful, if you could help me with that problem. If you need more information from my side, let me know.

Have a nice day and keep up the good work.
Markus
Click to expand...

Hey,

Like you said, it seems like you could solve it by tweaking the texture's params, like the mipmaps param.

You can search for "CreateExternalTexture" and you'll find a line in MediaPlayer8.cs where this is done. I see we're using mipmaps by default. I'm thinking of adding a field to MediaPlayer8 component to control the mipmaps parameter. In the meanwhile, feel free to add it yourself and make sure to analyze the diffs from any upcoming updates to keep those changes.

Hope this helps!

DPRH · Aug 12, 2021

Hi,
Any possibility to add playback speed control to plugin?
Thanks.
Dmitry

P_jvillar · Feb 16, 2022

hi,
Is it posible to use as a source a bite[] stream in h264 instead of a file/url?
thanks
Javi

thefallengamesstudio · Feb 25, 2022

P_jvillar said: ↑

hi,
Is it posible to use as a source a bite[] stream in h264 instead of a file/url?
thanks
Javi
Click to expand...

Hey. Not directly with the current implementation. May I suggest you use an intermediary file for this? I know it's not prefect but if you already have the bytes buffer, might as well write it to a file in real time. The player should handle it, provided that the format of the bytes are made for incremental reads. The only problem you need to look for is disk space. Not a perfect solution, but could be enough

DPRH said: ↑

Hi,
Any possibility to add playback speed control to plugin?
Thanks.
Dmitry
Click to expand...

Hey. Android: should be already possible by accessing the native exoplayer part via AndroidJavaObject/AndroidJavaClass, but you need good native Android knowledge and the exoplayer's API.

FawnMarkus said: ↑

Hey thefallengamesstudio,

Thanks for the reply, but unfortunately all my configuration attempts didn't work. I checked out the CreateExternalTexture method, but it doesn't get called since I already applied a target texture via the editor. This texture hasn't mip maps enabled and looks perfectly fine while in editor mode on Windows. After setting the texture pointer from within the MediaPlayer8.cs it seems to mess around with the settings. Do you know if there is a render surface setting for the exo player to prevent this?

Thanks again and have a nice day.
Markus
Click to expand...

I wasn't notified about your message, sorry. It's already too late, but I respond anyway: yes, there's a Surface object created on android side which might interfere with this

Hosnkobf · Mar 29, 2023

Hi,
I have seen that you are not supporting DRM but from your comments 5 years ago, it looks like you actually got it working on *some* devices... I really need this feature for a project which has only one target device (HTC Vive Flow). Couldn't you simply release it as experimental feature, so I can try if it works on my device?

Search Unity

MediaPlayer8 - all-purpose, streaming & caching support

What's the next platform you'd like us to support?

Windows PC

iOS

Windows Phone

thefallengamesstudio

ghasedak3411

thefallengamesstudio

bharathrajad

thefallengamesstudio

thefallengamesstudio

DPRH

P_jvillar

thefallengamesstudio

Hosnkobf

Search Unity

Unity ID

MediaPlayer8 - all-purpose, streaming & caching support

What's the next platform you'd like us to support?

Windows PC

iOS

Windows Phone