Page 1 of 1

VLC Stops streaming after ~12 hours

Posted: 13 Jul 2016 11:50
by Deleted
Hey,

I've got a server trans coding a stream so that the trans coded stream can be viewed within the building. I have to restart the stream every morning because it stops working over night. For example, yesterday I restarted the stream at around 9am and it froze and 3am the following morning.
cvlc udp://@***.***.***.***:5000 --sout '#transcode{vcodec=h264,venc=x264{preset=ultrafast},scale=Auto,acodec=mpga,ab=128,scodec=dvbs,soverlay,scale=1}:standard{access=http,mux=ts,dst=:8090/}' -vvv --vbi-page=0 --sout-keep --verbose=2 --logfile=/home/alex/vlc-log.txt
Any ideas how I could fix this? Note, its running as a service on the box, but it was doing this before then.

OS: Linux (CentOS 7)

I've thought about doing things like making a cron that'll restart the service everyday, but this isn't fixing the underlying issue.

Other things to note: I'm running Zabbix to monitor the server, It's not reporting that I've used up all my Memory or Disk in the machine, I also cannot get to the logs since the logs get filled up with:
Jul 13 07:06:51 cvlc[2700]: [00007fcb044c8da8] mux_ts mux warning: packet with too strange dts (dts=145548737467,old=0,pcr=55709594050)
Jul 13 07:06:52 cvlc[2700]: [00007fcb044c8da8] mux_ts mux warning: packet with too strange dts (dts=145548761467,old=0,pcr=55709634050)
Jul 13 07:06:52 cvlc[2700]: [00007fcb044c8da8] mux_ts mux warning: packet with too strange dts (dts=145548785467,old=0,pcr=55709674050)
Jul 13 07:06:52 cvlc[2700]: [00007fcb044c8da8] mux_ts mux warning: packet with too strange dts (dts=145548809467,old=0,pcr=55709714050)
Jul 13 07:06:52 cvlc[2700]: [00007fcb044c8da8] mux_ts mux warning: packet with too strange dts (dts=145548833467,old=0,pcr=55709754050)
And thus can't go back far enough to see what error caused this to happen.

Cheers!

Re: VLC Stops streaming after ~12 hours

Posted: 22 Jul 2016 10:10
by InTheWings
33 bits timestamp wrapping not handled.

Re: VLC Stops streaming after ~12 hours

Posted: 22 Jul 2016 10:24
by Deleted
33 bits timestamp wrapping not handled.
How would I go about handling that? I have got abit more errors, infact at the exact point where it failed: (Anything at 15:46 is the time it failed.)
Jul 18 11:43:03 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (-3 -4)
Jul 18 11:56:55 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (15 -4)
Jul 18 12:13:24 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (2 -6)
Jul 18 12:33:35 oregano cvlc[24081]: [00007fd5584ca638] stream_out_transcode stream out warning: Reseting video sync
Jul 18 13:45:44 oregano cvlc[24081]: [00007fd5584ca638] stream_out_transcode stream out warning: Reseting video sync
Jul 18 14:02:27 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (14 -1)
Jul 18 14:02:27 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (13 -2)
Jul 18 14:02:27 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (13 -2)
Jul 18 14:57:35 oregano cvlc[24081]: [00007fd5584ca638] stream_out_transcode stream out warning: Reseting video sync
Jul 18 15:02:36 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (18 -2)
Jul 18 15:09:36 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (15 -1)
Jul 18 15:11:20 oregano cvlc[24081]: [mpeg2video @ 0x7fd53c0016e0] MPEG motion vector out of boundary (12 -4)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584ca638] stream_out_transcode stream out warning: Reseting video sync
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442173120)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442149340)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810286864,old=23633299965,pcr=23633299965)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442157032)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810246864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442137923)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810206864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442114540)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810166864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442125585)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810126864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442107720)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810086864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442087366)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810046864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442107411)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810006864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442081305)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809966864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442062043)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809926864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442065780)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809886864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442046101)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809846864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442023751)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809806864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442044015)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809766864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442023282)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809726864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442001563)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809686864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5540009b8] core input warning: clock gap, unexpected stream discontinuity
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5540009b8] core input warning: feeding synchro with a new reference point trying to recover from clock gap
Jul 18 15:46:50 oregano cvlc[24081]: [00007fd5584ca638] stream_out_transcode stream out warning: Reseting video sync
Jul 18 15:46:50 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442255446)
Jul 18 15:46:50 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71809646864,old=0,pcr=0)
Jul 18 15:46:50 oregano cvlc[24081]: [00007fd5584ca638] stream_out_transcode stream out warning: Reseting video sync
Jul 18 15:46:50 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442246534)

Re: VLC Stops streaming after ~12 hours

Posted: 22 Jul 2016 14:21
by kmf31
It might be interesting for you to read this:
https://forum.videolan.org/viewtopic.php?f=4&t=132666

I am not sure if this is related but there is a clear issue with certain type of h264 TS-fluxes and the vlc-packetizer for h264 and your error messages look very very familiar to me !

Re: VLC Stops streaming after ~12 hours

Posted: 22 Jul 2016 15:15
by Deleted
It might be interesting for you to read this:
https://forum.videolan.org/viewtopic.php?f=4&t=132666

I am not sure if this is related but there is a clear issue with certain type of h264 TS-fluxes and the vlc-packetizer for h264 and your error messages look very very familiar to me !
Cheers for that, I'll have a look into it. Not liking the idea of having to recompile VLC :P

Re: VLC Stops streaming after ~12 hours

Posted: 22 Jul 2016 15:26
by Rémi Denis-Courmont
If there are 32-bits overflow problems, you'd have to fix them. Presumably, that involves identifying where they occur, and them correcting the arithmetic, e.g. by using larger integer types.

In other words, it means patching the VLC source code.

Re: VLC Stops streaming after ~12 hours

Posted: 22 Jul 2016 16:28
by Deleted
If there are 32-bits overflow problems, you'd have to fix them. Presumably, that involves identifying where they occur, and them correcting the arithmetic, e.g. by using larger integer types.

In other words, it means patching the VLC source code.
is it worth raising this as a bug in VLC to be fixed in a future VLC verison? If I get a chance, I'll have a look through the source code, maybe even submit a fix? For now, I'll just make a work around to restart the command daily.

Alex

Re: VLC Stops streaming after ~12 hours

Posted: 24 Jul 2016 23:32
by InTheWings
33 bits timestamp wrapping not handled.
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442173120)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442149340)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810286864,old=23633299965,pcr=23633299965)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442157032)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] mux_ts mux warning: packet with too strange dts (dts=-71810246864,old=0,pcr=0)
Jul 18 15:46:49 oregano cvlc[24081]: [00007fd5584c8da8] core mux warning: late buffer for mux input (95442137923)
[/quote]

As suspected the 95.10^6 values are to the end of the 33 bit clock precision.
So the issue is with the rollover which seems mishandled by mux.

Re: VLC Stops streaming after ~12 hours

Posted: 20 Mar 2017 16:06
by TheCompWiz
Has any progress been made on this issue? ... I am running into the exact same issue. I'd rather not stop & start the stream every 12 hours or so.

Re: VLC Stops streaming after ~12 hours

Posted: 20 Mar 2017 17:12
by Rémi Denis-Courmont
Well... if InTheWings is right, the issue is with the muxer. So you need to fix the sender side. Don't expect progress on VLC client side then.