In VLCKit,is there an approach that can get pixels buff of video every frame?

[xrddd]

I want get the video pixels buff in my app loop,so I can use it as texture to render myself.
Any help appreciate!

[fkuehne]

The only supported way for this is to use the vmem output module, which would require all your frames to pass through the main application memory, which can have a significant performance impact and would require changes to VLCKit itself, as we currently don't expose this API on the ObjC side of things.

I'm wondering what you are trying to achieve?

[xrddd]

The only supported way for this is to use the vmem output module, which would require all your frames to pass through the main application memory, which can have a significant performance impact and would require changes to VLCKit itself, as we currently don't expose this API on the ObjC side of things.

I'm wondering what you are trying to achieve?

Thanks Felix! I want to get the video frame picture in my app's every frame,so with that frame picture data(using as GL texture), draws myself via OpenGLES,achieving video playing.
what I know is,VLC-android has IVLCVout interface(which can set setVideoSurface),and via SurfaceTexture we can capture frames from video stream as an OpenGL ES texture easily.
May be there isn't a counterpart in iOS, or exactly on ObjC side?

[unidan]

Hi,

On libvlc 4, you would have opengl callbacks for this, but it isn't released yet and vlckit isn't compatible yet.

[xrddd]

Hi,

On libvlc 4, you would have opengl callbacks for this, but it isn't released yet and vlckit isn't compatible yet.

hi, unidan,thanks for your reply. is a VLCKit branch(even developing) available that has the feature? I can build from it.

[unidan]

> hi, unidan,thanks for your reply. is a VLCKit branch(even developing) available that has the feature? I can build from it.

Not from now, but VLCKit is being ported to libVLC4 currently.

[vicybvr]

Hi

I would be very interesting in this as well. My use case is, i guess, similar to what xrddd describes: I also want to use the texture in a custom mesh, and add some custom vertex and fragment shading, for my application.

So, whenever a shareable version of VLCKit that yoiu feel comfortable opening, i would love to beta test it!

[XuanTung]

Hi team,
VLCKit 4.0 is available now, is this feature available yet?

[fkuehne]

There are very early alpha builds of VLCKit v4 available. However, the API mentioned by @unidan is not public yet.

[ssbmaccom]

Sorry to be a bit off-topic, but I thought with libvlc4 you wanted to get around OpenGL as it may get deprecated on Apple platforms and eg. Catalyst framework does not include OpenGL. So I am a bit curious, if there will be a OpenGL callback, when OpenGL is not used anymore.
But actually I would also be interested in grabbing single full frames from streams via VLCKit. Got an idea to utilize them for a mart feature.