Issue showing H265 stream from Cam , works at daytime , not at Night (IR)

[vlc0910]

Hello VLC Team

First time poster ... Go easy on me.

I have a strange issue here
I have just setup a 4K IP Camera in the summerhouse, and have set it for H265 encoding.
VLC 3.0.18 (Mint Flatpack) works fine during daytime (rtsp) , showing the stream in "full color".
But when the camera switches to night mode (IR) - Graytones.
The stream doesn't run , it shows one "still frame" , and nothing more happens.
If i "refresh/reload" the stream" it will show anther "still".
H265 Codec (Statistics) counts up .. Is receiving , but no frames are shown.

If i switch to H264 , the stream works at night time too.

The strange part is that: The same H265 stream works at daytime.
Like it's somehow the IR (Graytones) that confuses the H265 decoder.



PC:

Code: Select all

Laptop - Lenovo CPU : Intel(R) Core(TM) i5-10310U CPU @ 1.70GHz Ram . 16G GFX : Built in Intel 915 - Mesa 23.0.4-0ubuntu1~22.04.1

OS:

Code: Select all

$ cat /etc/os-release NAME="Linux Mint" VERSION="21.2 (Victoria)" ID=linuxmint ID_LIKE="ubuntu debian" PRETTY_NAME="Linux Mint 21.2" VERSION_ID="21.2"

VLC installed from MINT Flatpack Repos - The "Older apt version wont stream the rtsp at all"

Code: Select all

$ /usr/bin/flatpak run --branch=stable --arch=x86_64 --command=/app/bin/vlc --file-forwarding org.videolan.VLC --version VLC media player 3.0.18 Vetinari (revision 3.0.13-8-g41878ff4f2) VLC version 3.0.18 Vetinari (3.0.13-8-g41878ff4f2) Compiled by buildbot on cncf-x86-4.flathub.org (Jul 2 2023 20:21:18) Compiler: gcc version 12.2.0 (GCC) This program comes with NO WARRANTY, to the extent permitted by law. You may redistribute it under the terms of the GNU General Public License; see the file named COPYING for details. Written by the VideoLAN team; see the AUTHORS file.

VLC started from commandline - Daytime - Working fine (no further messages in console)

Code: Select all

$ /usr/bin/flatpak run --branch=stable --arch=x86_64 --command=/app/bin/vlc --file-forwarding org.videolan.VLC VLC media player 3.0.18 Vetinari (revision 3.0.13-8-g41878ff4f2) [00005556bba4d710] main libvlc: Running vlc with the default interface. Use 'cvlc' to use vlc without interface. Gtk-Message: 09:32:17.597: Failed to load module "xapp-gtk3-module" Qt: Session management error: Could not open network socket [00005556bbae8820] main playlist: playlist is empty Created new TCP socket 30 for connection MultiFramedRTPSource::doGetNextFrame1(): The total received frame size exceeds the client's buffer size (250000). 22291 bytes of trailing data will be dropped! libva info: VA-API version 1.18.0 libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/intel-vaapi-driver/iHD_drv_video.so libva info: Found init function __vaDriverInit_1_18 libva info: va_openDriver() returns 0 [00007f7a200134f0] avcodec decoder: Using Intel iHD driver for Intel(R) Gen Graphics - 23.2.1 () for hardware decoding

If i start the same stream (VLC) at nighttime , i see tonzz of messages on the commandline console

I have gathered some pictures , but have no idea how to attach them


Edit: If i open the "Night time" stream with VLC my iPhone13 : AppStore - VLC IOS 3.4.9 (550).
The H265 stream works.

Thank you for an excellent program
/vlc0910

[vlc0910]

I could make a VirtualBox "Mint" , and try out the "Daily snapshot".
Or even make a new Mint install on another i5 laptop , and install the daily snapshot.

What would be the recommended action, for debugging & create a PR (Bug) for this one ?
The reason i think it might be a Bug (on linux mint) , is that it works in daylight , but not at night (IR LEDS).

I don't have any Windows machines so i can't test there.

It does work at night on my iPhone using the latest VLC.

[Rémi Denis-Courmont]

Try disabling hardware decoding acceleration.

[vlc0910]

Try disabling hardware decoding acceleration.

Done

Input Codecs --> HW Accel decoding --> Disabled.

Pict still fine (Daytime) ... Laptop fan "Light noise" .. Prob. due to the SW decoding.

TOP reports VLC using around 60% ... Must be of "1 Core".
It's a 4Core HT , and no core is heavy loaded ... Max is Approx 27% on one core ... switching around.


Will see tonight , and try to start via commandline , and post those messages it writes.
I remember it suggested too little CPU power , but i don't buy that ....

Thank you for your support

[vlc0910]

The Cam has now switched to Night/IR mode

I have the same issue without HW Accel. enabled.
VLC Freezes showing "One Frame" , I can see it is frozen by the NON changing Camera overlay Time.


********** HW Accel enabled

Code: Select all

~$ /usr/bin/flatpak run --branch=stable --arch=x86_64 --command=/app/bin/vlc --file-forwarding org.videolan.VLC rtsp://sv-cam-01/stream1 VLC media player 3.0.18 Vetinari (revision 3.0.13-8-g41878ff4f2) [000055ac06f68710] main libvlc: Running vlc with the default interface. Use 'cvlc' to use vlc without interface. Gtk-Message: 20:06:10.632: Failed to load module "xapp-gtk3-module" Qt: Session management error: Could not open network socket Created new TCP socket 28 for connection libva info: VA-API version 1.18.0 libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/intel-vaapi-driver/iHD_drv_video.so libva info: Found init function __vaDriverInit_1_18 libva info: va_openDriver() returns 0 [00007f76e40135b0] avcodec decoder: Using Intel iHD driver for Intel(R) Gen Graphics - 23.2.1 () for hardware decoding [00007f76e40135b0] main decoder error: buffer deadlock prevented MultiFramedRTPSource::doGetNextFrame1(): The total received frame size exceeds the client's buffer size (250000). 41303 bytes of trailing data will be dropped! [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [00007f76e4013e40] hevc packetizer: Waiting for VPS/SPS/PPS [hevc @ 0x7f76dc038440] Could not find ref with POC 6 [hevc @ 0x7f76dc038440] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc038440] hardware accelerator failed to decode picture [hevc @ 0x7f76dc08f640] Could not find ref with POC 8 [hevc @ 0x7f76dc08f640] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc08f640] hardware accelerator failed to decode picture [hevc @ 0x7f76dc09fa40] Could not find ref with POC 10 [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f76e40135b0] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [hevc @ 0x7f76dc0b0340] Could not find ref with POC 12 [hevc @ 0x7f76dc0b0340] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc0b0340] hardware accelerator failed to decode picture [hevc @ 0x7f76dc0c0c00] Duplicate POC in a sequence: 12. [hevc @ 0x7f76dc0d14c0] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc0d14c0] hardware accelerator failed to decode picture [hevc @ 0x7f76dc0d14c0] Could not find ref with POC 12 [hevc @ 0x7f76dc0d14c0] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc0d14c0] hardware accelerator failed to decode picture [hevc @ 0x7f76dc0e1e00] Could not find ref with POC 0 [hevc @ 0x7f76dc0e1e00] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc0e1e00] hardware accelerator failed to decode picture [hevc @ 0x7f76dc0088c0] Could not find ref with POC 2 [hevc @ 0x7f76dc0088c0] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc0088c0] hardware accelerator failed to decode picture [hevc @ 0x7f76dc027e40] Could not find ref with POC 4 [hevc @ 0x7f76dc027e40] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc027e40] hardware accelerator failed to decode picture [hevc @ 0x7f76dc038440] Could not find ref with POC 6 [hevc @ 0x7f76dc038440] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc038440] hardware accelerator failed to decode picture [hevc @ 0x7f76dc08f640] Could not find ref with POC 8 [hevc @ 0x7f76dc08f640] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc08f640] hardware accelerator failed to decode picture [hevc @ 0x7f76dc09fa40] Could not find ref with POC 10 [hevc @ 0x7f76dc09fa40] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc09fa40] hardware accelerator failed to decode picture [hevc @ 0x7f76dc0b0340] Could not find ref with POC 12 [hevc @ 0x7f76dc0b0340] Failed to end picture decode issue: 23 (internal decoding error). [hevc @ 0x7f76dc0b0340] hardware accelerator failed to decode picture [hevc @ 0x7f76dc0c0c00] Could not find ref with POC 0

[vlc0910]

HW Accel disabled

Code: Select all

~$ /usr/bin/flatpak run --branch=stable --arch=x86_64 --command=/app/bin/vlc --file-forwarding org.videolan.VLC rtsp://sv-cam-01/stream1 VLC media player 3.0.18 Vetinari (revision 3.0.13-8-g41878ff4f2) [00005624176aa710] main libvlc: Running vlc with the default interface. Use 'cvlc' to use vlc without interface. Gtk-Message: 20:08:01.237: Failed to load module "xapp-gtk3-module" Qt: Session management error: Could not open network socket Created new TCP socket 28 for connection libva info: VA-API version 1.18.0 libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/intel-vaapi-driver/iHD_drv_video.so libva info: Found init function __vaDriverInit_1_18 libva info: va_openDriver() returns 0 [00007f0010013650] main decoder error: buffer deadlock prevented MultiFramedRTPSource::doGetNextFrame1(): The total received frame size exceeds the client's buffer size (250000). 48810 bytes of trailing data will be dropped! [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [00007f0010013ee0] hevc packetizer: Waiting for VPS/SPS/PPS [hevc @ 0x7f0000038180] Could not find ref with POC 6 [hevc @ 0x7f0000088500] Could not find ref with POC 8 [hevc @ 0x7f0000098bc0] Could not find ref with POC 10 [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [hevc @ 0x7f00000a94c0] Could not find ref with POC 12 [hevc @ 0x7f00000b9e00] Duplicate POC in a sequence: 12. [hevc @ 0x7f00000ca680] Duplicate POC in a sequence: 13. [hevc @ 0x7f0000038180] Could not find ref with POC 12 [hevc @ 0x7f0000088500] Could not find ref with POC 0 [hevc @ 0x7f0000098bc0] Could not find ref with POC 2 [hevc @ 0x7f00000a94c0] Could not find ref with POC 4 [hevc @ 0x7f00000b9e00] Could not find ref with POC 6 [hevc @ 0x7f00000ca680] Could not find ref with POC 8 [hevc @ 0x7f00000db040] Could not find ref with POC 10 [hevc @ 0x7f0000009a00] Could not find ref with POC 12 [hevc @ 0x7f0000027b80] Could not find ref with POC 0 [hevc @ 0x7f0000038180] Could not find ref with POC 2 [hevc @ 0x7f0000088500] Could not find ref with POC 4 [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [00007f0010013650] avcodec decoder error: more than 5 seconds of late video -> dropping frame (computer too slow ?) [hevc @ 0x7f0000038180] Duplicate POC in a sequence: 10. [hevc @ 0x7f0000088500] Duplicate POC in a sequence: 11. [hevc @ 0x7f00000ca680] Could not find ref with POC 10 [hevc @ 0x7f00000db040] Could not find ref with POC 12 [hevc @ 0x7f0000009a00] Could not find ref with POC 0 [hevc @ 0x7f0000027b80] Could not find ref with POC 2 [hevc @ 0x7f00000b9e00] Duplicate POC in a sequence: 7. [hevc @ 0x7f0000027b80] Could not find ref with POC 6 [hevc @ 0x7f0000038180] Could not find ref with POC 8 [hevc @ 0x7f0000088500] Could not find ref with POC 10 [hevc @ 0x7f0000098bc0] Could not find ref with POC 12 [hevc @ 0x7f00000a94c0] Could not find ref with POC 0 [hevc @ 0x7f00000b9e00] Could not find ref with POC 2 [hevc @ 0x7f00000ca680] Could not find ref with POC 4 ^C ~$

I tested once again with my iPhone , and VLC shows the H265 stream there wo.any issues.


One thing i noticed though, was that even wo. the cam switching to Night (IR) mode.
But at low light condition, the H265 stream stopped.

So it seems like Camera low light or IR mode somehow breaks the H265 decoding on linux.

If i switch to H264 , VLC on linux works w HW Accel decoding.

This is strange ....
But since the H265 can be shown on my iPhone , i suppose the stream is ok ... Or ??

The message about the computer being to slow ...
I don't think so, it works fine in daylight , and none of the Cores were loaded (Quad Core HT)

[Rémi Denis-Courmont]

The stream seems corrupt, or at least FFmpeg thinks it is.

And it is entirely possible that the computer is too slow if hardware decoding acceleration is disabled.

[vlc0910]

The stream seems corrupt,

It shows fine with latest VLC on the iPhone.

or at least FFmpeg thinks it is.

On that we can agree

And it is entirely possible that the computer is too slow if hardware decoding acceleration is disabled.

It says the same with HW Accel enabled.

How do we proceed from here ??

[Rémi Denis-Courmont]

iPhone doesn't use FFmpeg for hardware decoding so that proves nothing. In any case, VLC can't do anything if FFmpeg thinks the stream is corrupt. If you think it's an FFmpeg bug, you need to update FFmpeg (libavcodec) to a fixed versions (if it exists).

But my guess is that the stream is corrupt.

[vlc0910]

Thank you for the answers.

Does VLC use a "builtin" FFmpeg , or the one installed with the OS (APT) ?
Do you know if the "Flatpack" VLC , is totally selfcontained ...AKA FFmpeg is in included in the package ?

[Rémi Denis-Courmont]

It varies depending on the VLC build. VLC source supports both styles. The Flatpak is not developed by VideoLAN, so I have no idea.