Freezing video after some time

[luca87]

I have a Ubuntu 18.04 distribution, I developed a video player which reproduce videos in my playlist in a customized order.
I initialized vlc with “play-and-pause” option, at the end of each video vlc is paused and I choose the next video to play within my playlist.
I have 2 problems:

-If I use fullscreen mode the reproduction is fluid but after some time (randomly) the video freeze, the audio carries on and “at the end of the video” I receive the “position changed “ event with the new position at 100% in an infinite loop. In this case in the console I have many error messages “hevc : could not find ref with POC XX”

-if I reproduce the video in a Qt x11 window I don’t have this problem but the reproduction is jerky. The gnome-shell took 10% of the cpu ( in the fullscreen mode is close to 0% ).

The hw acceleration is enable in both cases, and my videos are 4k 60 FPS.

Do you have any suggestion to have the fullscreen mode working properly?

Thanks

[Rémi Denis-Courmont]

It sounds like the first problem is a bug in the hardware decoding driver and the second case is, for a reason or another, inhibiting hardware decoding. Presumably VLC behaves like the first case?

[luca87]

Yes, VLC behaves in the same way. If i play in a loop and fullscreen mode my playlist after some videos I have the same problem: Audio is carrying on but video is freezing.
If I play VLC in a window the reproduction is jerky.

What I don't understand is: The first video I play never has problems.. So I tried to close the process at the end of each video and open new process to play the next video.
For each video I run a new process and call libvlc_new() function etc etc... and after some times i have the same problem! It seems not enough colse and reopen the process.

Is there any register to clear in vlc to completely restart is?
Does this behavior mean anything to you?

thank you very much for your help!

[InTheWings]

What makes you believe your computer can handle 4K 60FPS HEVC ?

[luca87]

I have a ApolloLake intel atom e3930 processor. It should decode 3 stream 3840x2160 h.264 or h.265 30 FPS.
So i think it can afford also 1 stream 3840x2160 h.265 60fps..

The fullscreen problem is present also with HD videos, but when HD videos are reproduced in a window ,and not fullscreen, I have no problems.

[InTheWings]

I have a ApolloLake intel atom e3930 processor. It should decode 3 stream 3840x2160 h.264 or h.265 30 FPS.
So i think it can afford also 1 stream 3840x2160 h.265 60fps..

The fullscreen problem is present also with HD videos, but when HD videos are reproduced in a window ,and not fullscreen, I have no problems.

Maybe I should try to boost a single cpu core to 10GHz because it has 4 3Ghz cores.

That's NOT how hardware works.

[luca87]

yes, I understand.. but a part from 60FPS videos, I have the same problem on HD videos. And for sure the processor can handle this kind of videos.
After some videos in fullscreen mode audio is carrying on but video is freezing..

[fossette]

luca87, Is there some logs that you can generate that would help the developers isolate the problen should a problem exist?

[luca87]

luca87, Is there some logs that you can generate that would help the developers isolate the problen should a problem exist?

log of playing video

libva info: VA-API version 1.1.0
libva info: va_getDriverName() returns 0
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/i965_drv_video.so
libva info: Found init function __vaDriverInit_1_1
libva info: va_openDriver() returns 0
[00007f9750026c00] avcodec decoder: Using Intel i965 driver for Intel(R) Broxton - 2.1.0 for hardware

decoding

log of playing video 2:
[00007f9750c5d130] main decoder error: buffer deadlock prevented
[00007f9750c5d9c0] mpeg4audio packetizer: AAC channels: 2 samplerate: 48000
libva info: VA-API version 1.1.0
libva info: va_getDriverName() returns 0
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/i965_drv_video.so
libva info: Found init function __vaDriverInit_1_1
libva info: va_openDriver() returns 0
[00007f9750c56cc0] avcodec decoder: Using Intel i965 driver for Intel(R) Broxton - 2.1.0 for hardware

decoding


log of problematic video:
[hevc @ 0x7f9750caa820] Could not find ref with POC 276
[hevc @ 0x7f9750caa820] Could not find ref with POC 279
[hevc @ 0x7f9750caa820] Could not find ref with POC 297
[hevc @ 0x7f9750caa820] Could not find ref with POC 303
[hevc @ 0x7f9750caa820] Could not find ref with POC 309
[hevc @ 0x7f9750caa820] Could not find ref with POC 315
[hevc @ 0x7f9750caa820] Could not find ref with POC 321
[hevc @ 0x7f9750caa820] Could not find ref with POC 327
[hevc @ 0x7f9750caa820] Could not find ref with POC 333
[hevc @ 0x7f9750caa820] Could not find ref with POC 339
[hevc @ 0x7f9750caa820] Could not find ref with POC 345
[hevc @ 0x7f9750caa820] Could not find ref with POC 351
[hevc @ 0x7f9750caa820] Could not find ref with POC 357
[hevc @ 0x7f9750caa820] Could not find ref with POC 363
[hevc @ 0x7f9750caa820] Could not find ref with POC 369
[hevc @ 0x7f9750caa820] Could not find ref with POC 375
[hevc @ 0x7f9750caa820] Could not find ref with POC 381
[hevc @ 0x7f9750caa820] Could not find ref with POC 387
[hevc @ 0x7f9750caa820] Could not find ref with POC 393
[hevc @ 0x7f9750caa820] Could not find ref with POC 399
[hevc @ 0x7f9750caa820] Could not find ref with POC 405
[hevc @ 0x7f9750caa820] Could not find ref with POC 411
[hevc @ 0x7f9750caa820] Could not find ref with POC 417
[hevc @ 0x7f9750caa820] Could not find ref with POC 3
[hevc @ 0x7f9750caa820] Could not find ref with POC 9
......
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[00007f975002a1f0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?)
[hevc @ 0x7f9750caa820] Could not find ref with POC 252
[hevc @ 0x7f9750caa820] Could not find ref with POC 267
[hevc @ 0x7f9750caa820] Could not find ref with POC 273
[hevc @ 0x7f9750caa820] Could not find ref with POC 279
[hevc @ 0x7f9750caa820] Could not find ref with POC 285
[hevc @ 0x7f9750caa820] Could not find ref with POC 291
[hevc @ 0x7f9750caa820] Could not find ref with POC 297
[hevc @ 0x7f9750caa820] Could not find ref with POC 303
....

[luca87]

with HD videos i got these errors :

[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 65561
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 65537
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 65537
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 65555
[h264 @ 0x7fe424022f00] Missing reference picture, default is 65555
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 65537
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 65537
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 65537
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 65537
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 65555
[h264 @ 0x7fe424022f00] Missing reference picture, default is 65555
[h264 @ 0x7fe4240a94c0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240a94c0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240a94c0] Missing reference picture, default is 65567
[h264 @ 0x7fe4240a94c0] Missing reference picture, default is 65567
[h264 @ 0x7fe4240a94c0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240a94c0] Missing reference picture, default is 65543
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 2147483647
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 65555
[h264 @ 0x7fe4240d9ba0] Missing reference picture, default is 65555
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 65567
[h264 @ 0x7fe424022f00] Missing reference picture, default is 65567
[h264 @ 0x7fe424022f00] Missing reference picture, default is 2147483647
[h264 @ 0x7fe424022f00] Missing reference picture, default is 65567

[luca87]

Same problem with VLC in --fullscreen --loop mode.
Here the log with --verbose=3 and --avcodec-debug=1

[h264 @ 0x7fbff0174c00] slice:1 B mb:80 B fix frame:2 poc:2147483647/65540 ref:2/2 qp:13 loop:1:-2:-2 weight:0 SPAT
[h264 @ 0x7fbff0174c00] Param buffer (type 0, 672 bytes) is 0x8000005.
[h264 @ 0x7fbff0174c00] Param buffer (type 1, 240 bytes) is 0x8000006.
[h264 @ 0x7fbff0174c00] Slice 0 param buffer (3128 bytes) is 0x8000000.
[h264 @ 0x7fbff0174c00] Slice 0 data buffer (8596 bytes) is 0x8000007.
[h264 @ 0x7fbff0174c00] Decode to surface 0x400001f.
[h264 @ 0x7fbff0174c00] slice:1 T mb:0 B fix frame:2 poc:65541/65540 ref:2/2 qp:13 loop:1:-2:-2 weight:0 SPAT
[h264 @ 0x7fbff0174c00] Param buffer (type 0, 672 bytes) is 0x8000007.
[h264 @ 0x7fbff0174c00] Param buffer (type 1, 240 bytes) is 0x8000000.
[h264 @ 0x7fbff0174c00] Slice 0 param buffer (3128 bytes) is 0x8000006.
[h264 @ 0x7fbff0174c00] Slice 0 data buffer (9840 bytes) is 0x8000005.
[h264 @ 0x7fbff0174c00] Decode to surface 0x400001f.
[h264 @ 0x7fbff0041b40] nal_unit_type: 1, nal_ref_idc: 2
[h264 @ 0x7fbff0041b40] nal_unit_type: 1, nal_ref_idc: 2
[00007fbfcc003890] main input debug: EOF reached
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
[0000561655345430] pulse audio output debug: underflow
[0000561655345430] pulse audio output debug: changing sink 0: alsa_output.pci-0000_00_0e.0.hdmi-stereo-extra1 (Built-in Audio Digital Stereo (HDMI 2))
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
...
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
[00007fbfcc003890] main input debug: waiting decoder fifos to empty
[000056165532d0c0] main vout display debug: auto hiding mouse cursor
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 12136 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 12096 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 12056 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 12016 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11976 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11936 ms)
[h264 @ 0x7fbff0041b40] slice:1 B mb:80 P fix frame:2 poc:2147483647/65548 ref:4/1 qp:9 loop:1:-2:-2 weight:0
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11896 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11856 ms)
...
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11336 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11296 ms)
[h264 @ 0x7fbff0041b40] Param buffer (type 0, 672 bytes) is 0x8000005.
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11256 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11217 ms)
[00007fbfb8076780] main video output warning: picture is too late to be displayed (missing 11177 ms)
[h264 @ 0x7fbff0041b40] Param buffer (type 1, 240 bytes) is 0x8000006.
[h264 @ 0x7fbff0041b40] Slice 0 param buffer (3128 bytes) is 0x8000000.
[h264 @ 0x7fbff0041b40] Slice 0 data buffer (46697 bytes) is 0x8000007.
[h264 @ 0x7fbff0041b40] Decode to surface 0x4000005.
[h264 @ 0x7fbff0041b40] slice:1 T mb:0 P fix frame:2 poc:65549/65548 ref:5/1 qp:9 loop:1:-2:-2 weight:0
[h264 @ 0x7fbff0041b40] Param buffer (type 0, 672 bytes) is 0x8000007.
[h264 @ 0x7fbff0041b40] Param buffer (type 1, 240 bytes) is 0x8000000.
[h264 @ 0x7fbff0041b40] Slice 0 param buffer (3128 bytes) is 0x8000006.
[h264 @ 0x7fbff0041b40] Slice 0 data buffer (32541 bytes) is 0x8000005.
[h264 @ 0x7fbff0041b40] Decode to surface 0x4000005.
[h264 @ 0x7fbff01835c0] nal_unit_type: 1, nal_ref_idc: 0
[h264 @ 0x7fbff01835c0] nal_unit_type: 1, nal_ref_idc: 0