Audio and video module

This forum is about all development around libVLC.
danversj
New Cone
New Cone
Posts: 2
Joined: 06 May 2011 13:49

Re: Audio and video module

Postby danversj » 06 May 2011 14:13

Hi CrapulaX, nice work on this feature. I just got it working under Windows 7 with VLC v1.1.9. It was a bit tricky though.

Here's what I had to enable:
Preferences:Show settings:All
Audio/Filters > Enable "Audio part of the BarGraph function"
Audio/Filters/audiobargraph > used defaults, although I changed "Sends the barGraph information every n audio packets" to 1 to enable see a more accurate display
Interface/Main interfaces > Enabled "Remote control interface"
Interface/Main interfaces/RC > Enabled "Do not open a DOS command box interface"
Video/Subtitles-OSD > Enabled "Audio Bar Graph Video sub filter"
Video/Subtitles-OSD/Audio Bar Graph > Set the following settings:
\ "Value of the audio channels levels" = 0 (setting this to 0:1 crashed VLC)
\ "X coordinate" = 0
\ "Y coordinate" = 0 (this doesn't seem to affect anything)
\ "Transparency of the bargraph" = 128 for 50% transparency which looks ok
\ "Bargraph position" = Left (seems to only work Left,Center,Right - can't go top or bottom)
\ "Alarm" = 1
\ "Bar width in pixel" = 10 (20 if I want it to be really visible

To get it to work, I have to start VLC with the added command-line switch:
"C:\Program Files\VideoLAN\VLC\vlc.exe" --rc-host localhost:12345
I have added this switch to the "Target:" field my VLC shortcut

BUGS
If "Value of the audio channels levels" = 0:1, VLC crashes (probably because my audio doesn't have extra tracks - even so, it shouldn't crash)
If I play a .mov or .mxf file encoded with IMX-D10 (Bitrate: 50 Mbit/s), the audio bar graph does not show at all.
I cannot set the vertical size of the bar graph, or move it up and down. It is the full height of the window and i can't change it.
The bar graph audio display seems to be about 0.5 seconds in advance of the video and sound that is seen and heard. That is: sounds show up on the bar graph about 1/2 a second before they are heard. It would be nice to set the synchronisiation.

REQUESTS
I'd like to be able to control which audio tracks are displayed - if the stream or file has 2 x stereo audio tracks, or 4 mono tracks, I'd like to be able to view them all.
I'd like to be able to calibrate the bar graph, and see the scale measured in dB.

Jean-Baptiste Kempf
Site Administrator
Site Administrator
Posts: 37523
Joined: 22 Jul 2005 15:29
VLC version: 4.0.0-git
Operating System: Linux, Windows, Mac
Location: Cone, France
Contact:

Re: Audio and video module

Postby Jean-Baptiste Kempf » 06 May 2011 17:53

Hi CrapulaX, nice work on this feature. I just got it working under Windows 7 with VLC v1.1.9. It was a bit tricky though.

Here's what I had to enable:
Preferences:Show settings:All
Audio/Filters > Enable "Audio part of the BarGraph function"
Audio/Filters/audiobargraph > used defaults, although I changed "Sends the barGraph information every n audio packets" to 1 to enable see a more accurate display
Interface/Main interfaces > Enabled "Remote control interface"
Interface/Main interfaces/RC > Enabled "Do not open a DOS command box interface"
Video/Subtitles-OSD > Enabled "Audio Bar Graph Video sub filter"
Video/Subtitles-OSD/Audio Bar Graph > Set the following settings:
\ "Value of the audio channels levels" = 0 (setting this to 0:1 crashed VLC)
\ "X coordinate" = 0
\ "Y coordinate" = 0 (this doesn't seem to affect anything)
\ "Transparency of the bargraph" = 128 for 50% transparency which looks ok
\ "Bargraph position" = Left (seems to only work Left,Center,Right - can't go top or bottom)
\ "Alarm" = 1
\ "Bar width in pixel" = 10 (20 if I want it to be really visible

To get it to work, I have to start VLC with the added command-line switch:
"C:\Program Files\VideoLAN\VLC\vlc.exe" --rc-host localhost:12345
I have added this switch to the "Target:" field my VLC shortcut
Could you document this on our wiki, please?
BUGS
If "Value of the audio channels levels" = 0:1, VLC crashes (probably because my audio doesn't have extra tracks - even so, it shouldn't crash)
Mono input?
If I play a .mov or .mxf file encoded with IMX-D10 (Bitrate: 50 Mbit/s), the audio bar graph does not show at all.
Please share logs, but this is probably a blending issue on an impossible format.
I cannot set the vertical size of the bar graph, or move it up and down. It is the full height of the window and i can't change it.
Misfeature more than a bug...
The bar graph audio display seems to be about 0.5 seconds in advance of the video and sound that is seen and heard. That is: sounds show up on the bar graph about 1/2 a second before they are heard. It would be nice to set the synchronisiation.
This is annoying...
Jean-Baptiste Kempf
http://www.jbkempf.com/ - http://www.jbkempf.com/blog/category/Videolan
VLC media player developer, VideoLAN President and Sites administrator
If you want an answer to your question, just be specific and precise. Don't use Private Messages.

danversj
New Cone
New Cone
Posts: 2
Joined: 06 May 2011 13:49

Re: Audio and video module

Postby danversj » 07 May 2011 04:29


Could you document this on our wiki, please?
Done, here:
http://wiki.videolan.org/Documentation: ... Use_of_VLC
BUGS
If "Value of the audio channels levels" = 0:1, VLC crashes (probably because my audio doesn't have extra tracks - even so, it shouldn't crash)
Mono input?
Audio (Stream 1 only) is a stereo MPEG Audio layer 1/2/3 (mpga) - both bars display if I specify "0". The thing is, it shouldn't crash even if I specify 0:1 and it's only stereo.
If I play a .mov or .mxf file encoded with IMX-D10 (Bitrate: 50 Mbit/s), the audio bar graph does not show at all.
Please share logs, but this is probably a blending issue on an impossible format.
When the bargraph is working, these are the messages:

Code: Select all

main debug: net: connecting to localhost port 12345 main error: Read error: Connection reset by peer main debug: accepted socket 2348 (from socket 388) main debug: connection succeeded (socket = 2092) audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.119140:0.113996 main warning: vlc_object_find_name(audiobargraph_v) is not safe! audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.071552:0.075231 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.066988:0.080337 main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.034320:0.043010 main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: auto hidding mouse
When I play a clip that is IMX-D10 (50Mbit/s):
Codec Info:
Stream 0
Type: Video
Codec: MPEG-1/2 Video (mpgv)
Language: English
Resolution: 720x608
Frame rate:25

Stream 1
Type: Audio
Codec: PCM S16 LE (sowt)
Language: English
Channels: Stereo
Sample rate 48000 Hz
Bits per Sample: 16

Messages log (when the bar graph does NOT work):

Code: Select all

main debug: processing request item V8Wipe_F.imx.mov node Playlist skip 0 main debug: resyncing on V8Wipe_F.imx.mov main debug: V8Wipe_F.imx.mov is at 0 main debug: starting new item main debug: creating new input thread main debug: Creating an input for 'V8Wipe_F.imx.mov' main debug: thread started main debug: thread (input) created at priority 1 (../.././src/input/input.c:220) main debug: using timeshift granularity of 50 MiB main debug: using timeshift path 'C:\Users\aaa\AppData\Local\Temp' main debug: `file:///C:/V8Wipe_F.imx.mov' gives access `file' demux `' path `C:\V8Wipe_F.imx.mov' main debug: creating demux: access='file' demux='' path='C:\V8Wipe_F.imx.mov' main debug: looking for access_demux module: 2 candidates main debug: no access_demux module matching "file" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: creating access 'file' path='C:\V8Wipe_F.imx.mov' main debug: looking for access module: 2 candidates filesystem debug: opening file `C:\V8Wipe_F.imx.mov' main debug: using access module "filesystem" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: Using AStream*Stream main debug: pre buffering main debug: received first data after 0 ms main debug: pre-buffering done 1024 bytes in 0s - 1000000 KiB/s main debug: looking for stream_filter module: 2 candidates main debug: no stream_filter module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: looking for stream_filter module: 1 candidate main debug: using stream_filter module "stream_filter_record" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: creating demux: access='file' demux='' path='C:\V8Wipe_F.imx.mov' main debug: looking for demux module: 52 candidates mp4 debug: found Box: ftyp size 20 mp4 debug: found Box: wide size 8 mp4 debug: skip box: "wide" mp4 debug: found Box: mdat size 13678672 mp4 debug: skip box: "mdat" mp4 debug: found Box: moov size 1765 mp4 debug: found Box: mvhd size 108 mp4 debug: read box: "mvhd" creation 719084d-36h:00m:00s modification 719084d-36h:00m:00s time scale 1000 duration 694977d-48h:00m:00s rate 1.000000 volume 1.000000 next track id 3 mp4 debug: found Box: trak size 769 mp4 debug: found Box: tkhd size 92 mp4 debug: read box: "tkhd" creation 719084d-36h:00m:00s modification 719084d-36h:00m:00s duration 694977d-48h:35m:20s track ID 1 layer 0 volume 0.000000 width 720.000000 height 576.000000 mp4 debug: found Box: mdia size 669 mp4 debug: found Box: mdhd size 32 mp4 debug: read box: "mdhd" creation 719084d-36h:00m:00s modification 719084d-36h:00m:00s time scale 25 duration 694977d-48h:00m:53s language ``` mp4 debug: found Box: hdlr size 45 mp4 debug: read box: "hdlr" handler type vide name VideoHandler mp4 debug: found Box: minf size 584 mp4 debug: found Box: vmhd size 20 mp4 debug: read box: "vmhd" graphics-mode 0 opcolor (0, 0, 0) mp4 debug: found Box: hdlr size 44 mp4 debug: read box: "hdlr" handler type url name DataHandler mp4 debug: found Box: dinf size 36 mp4 debug: found Box: dref size 28 mp4 debug: found Box: url size 12 mp4 debug: read box: "url" url: (null) mp4 debug: read box: "dref" entry-count 1 mp4 debug: found Box: stbl size 476 mp4 debug: found Box: stsd size 168 mp4 debug: found Box: mx5p size 152 mp4 debug: found Box: glbl size 50 mp4 warning: unknown box type glbl (incompletely loaded) mp4 debug: found Box: pasp size 16 mp4 warning: unknown box type pasp (incompletely loaded) mp4 debug: read box: "vide" in stsd 720x576 depth 24 mp4 debug: read box: "stsd" entry-count 1 mp4 debug: found Box: stts size 24 mp4 debug: read box: "stts" entry-count 1 mp4 debug: found Box: stsc size 28 mp4 debug: read box: "stsc" entry-count 1 mp4 debug: found Box: stsz size 20 mp4 debug: read box: "stsz" sample-size 250408 sample-count 53 mp4 debug: found Box: stco size 228 mp4 debug: read box: "co64" entry-count 53 mp4 debug: found Box: trak size 849 mp4 debug: found Box: tkhd size 92 mp4 debug: read box: "tkhd" creation 719084d-36h:00m:00s modification 719084d-36h:00m:00s duration 694977d-48h:35m:20s track ID 2 layer 0 volume 1.000000 width 0.000000 height 0.000000 mp4 debug: found Box: mdia size 749 mp4 debug: found Box: mdhd size 32 mp4 debug: read box: "mdhd" creation 719084d-36h:00m:00s modification 719084d-36h:00m:00s time scale 48000 duration 694978d-16h:16m:00s language ``` mp4 debug: found Box: hdlr size 45 mp4 debug: read box: "hdlr" handler type soun name SoundHandler mp4 debug: found Box: minf size 664 mp4 debug: found Box: smhd size 16 mp4 debug: read box: "smhd" balance 0.000000 mp4 debug: found Box: hdlr size 44 mp4 debug: read box: "hdlr" handler type url name DataHandler mp4 debug: found Box: dinf size 36 mp4 debug: found Box: dref size 28 mp4 debug: found Box: url size 12 mp4 debug: read box: "url" url: (null) mp4 debug: read box: "dref" entry-count 1 mp4 debug: found Box: stbl size 560 mp4 debug: found Box: stsd size 52 mp4 debug: found Box: sowt size 36 mp4 debug: read box: "soun" mp4 or qt1/2 (rest=0) mp4 debug: read box: "soun" in stsd channel 2 sample size 16 sample rate 48000.000000 mp4 debug: read box: "stsd" entry-count 1 mp4 debug: found Box: stts size 24 mp4 debug: read box: "stts" entry-count 1 mp4 debug: found Box: stsc size 40 mp4 debug: read box: "stsc" entry-count 2 mp4 debug: found Box: stsz size 20 mp4 debug: read box: "stsz" sample-size 4 sample-count 101760 mp4 debug: found Box: stco size 416 mp4 debug: read box: "co64" entry-count 100 mp4 debug: found Box: udta size 31 mp4 debug: found Box: cswr size 23 mp4 debug: read box: "cswr" text=`Lavf52.84.0' mp4 debug: dumping root Box "root" mp4 debug: | + ftyp size 20 mp4 debug: | + wide size 8 mp4 debug: | + mdat size 13678672 mp4 debug: | + moov size 1765 mp4 debug: | | + mvhd size 108 mp4 debug: | | + trak size 769 mp4 debug: | | | + tkhd size 92 mp4 debug: | | | + mdia size 669 mp4 debug: | | | | + mdhd size 32 mp4 debug: | | | | + hdlr size 45 mp4 debug: | | | | + minf size 584 mp4 debug: | | | | | + vmhd size 20 mp4 debug: | | | | | + hdlr size 44 mp4 debug: | | | | | + dinf size 36 mp4 debug: | | | | | | + dref size 28 mp4 debug: | | | | | | | + url size 12 mp4 debug: | | | | | + stbl size 476 mp4 debug: | | | | | | + stsd size 168 mp4 debug: | | | | | | | + mx5p size 152 mp4 debug: | | | | | | | | + glbl size 50 mp4 debug: | | | | | | | | + pasp size 16 mp4 debug: | | | | | | + stts size 24 mp4 debug: | | | | | | + stsc size 28 mp4 debug: | | | | | | + stsz size 20 mp4 debug: | | | | | | + stco size 228 mp4 debug: | | + trak size 849 mp4 debug: | | | + tkhd size 92 mp4 debug: | | | + mdia size 749 mp4 debug: | | | | + mdhd size 32 mp4 debug: | | | | + hdlr size 45 mp4 debug: | | | | + minf size 664 mp4 debug: | | | | | + smhd size 16 mp4 debug: | | | | | + hdlr size 44 mp4 debug: | | | | | + dinf size 36 mp4 debug: | | | | | | + dref size 28 mp4 debug: | | | | | | | + url size 12 mp4 debug: | | | | | + stbl size 560 mp4 debug: | | | | | | + stsd size 52 mp4 debug: | | | | | | | + sowt size 36 mp4 debug: | | | | | | + stts size 24 mp4 debug: | | | | | | + stsc size 40 mp4 debug: | | | | | | + stsz size 20 mp4 debug: | | | | | | + stco size 416 mp4 debug: | | + udta size 31 mp4 debug: | | | + cswr size 23 mp4 debug: unrecognized major file specification (qt ). mp4 debug: found 2 tracks mp4 debug: track[Id 0x1] read 53 chunk mp4 debug: track[Id 0x1] read 53 samples length:2s main debug: selecting program id=0 mp4 debug: adding track[Id 0x1] video (enable) language en mp4 debug: track[Id 0x2] read 100 chunk mp4 debug: track[Id 0x2] read 101760 samples length:2s mp4 debug: adding track[Id 0x2] audio (enable) language en main debug: using demux module "mp4" main debug: TIMER module_need() : 10.000 ms - Total 10.000 ms / 1 intvls (Avg 10.000 ms) mp4 warning: control query 14 unimplemented qt4 debug: IM: Setting an input main debug: looking for a subtitle file in C:\ main debug: looking for decoder module: 34 candidates avcodec debug: libavcodec already initialized avcodec debug: trying to use direct rendering avcodec debug: ffmpeg codec (MPEG-1/2 Video) started main debug: using decoder module "avcodec" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: thread started main debug: thread (decoder) created at priority 0 (../.././src/input/decoder.c:301) main debug: looking for decoder module: 34 candidates araw debug: samplerate:48000Hz channels:2 bits/sample:16 main debug: using decoder module "araw" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: thread started main debug: thread (decoder) created at priority 2 (../.././src/input/decoder.c:301) main debug: looking for meta reader module: 2 candidates lua debug: Trying Lua scripts in C:\Users\aaa\AppData\Roaming\vlc\lua\meta\reader lua debug: Trying Lua scripts in C:\Program Files\VideoLAN\VLC\lua\meta\reader lua debug: Trying Lua playlist script C:\Program Files\VideoLAN\VLC\lua\meta\reader\filename.lua main debug: no meta reader module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: `file:///C:/V8Wipe_F.imx.mov' successfully opened mp4 debug: track[Id 0x1] does not provide Sync Sample Box (stss) mp4 debug: track[Id 0x2] does not provide Sync Sample Box (stss) main debug: Buffering 0% main debug: no usable vout present, spawning one main debug: looking for text renderer module: 2 candidates freetype debug: Building font databases. main debug: Buffering 0% main debug: Buffering 33% main debug: Buffering 66% main debug: Buffering 100% main debug: Stream buffering done (400 ms in 10 ms) freetype debug: Took 230000 microseconds freetype debug: Using Arial as font from file C:/windows/fonts/arial.ttf freetype debug: using fontsize: 2 main debug: using text renderer module "freetype" main debug: TIMER module_need() : 240.000 ms - Total 240.000 ms / 1 intvls (Avg 240.000 ms) main debug: looking for video filter2 module: 18 candidates swscale debug: 32x32 chroma: YUVA -> 16x16 chroma: YUVA with scaling using Bicubic (good quality) main debug: using video filter2 module "swscale" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: looking for video filter2 module: 18 candidates yuvp debug: YUVP to YUVA converter main debug: using video filter2 module "yuvp" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: window size: 810x576 main debug: Deinterlacing available main debug: deinterlace 0, mode blend, is_needed 0 main debug: looking for video output module: 1 candidate vout_wrapper debug: Opening vout display wrapper main debug: looking for vout display module: 8 candidates direct3d debug: creating Vout EventThread direct3d debug: DirectXCreateWindow main debug: looking for vout window hwnd module: 3 candidates qt4 debug: requesting video... qt4 debug: Video was requested 0, 0 qt4 debug: embedded video ready (handle 002907ee) main debug: using vout window hwnd module "qt4" main debug: TIMER module_need() : 35.000 ms - Total 35.000 ms / 1 intvls (Avg 35.000 ms) direct3d debug: created video sub-window direct3d debug: Vout EventThread running direct3d debug: disabling screen saver main debug: VoutDisplayEvent 'resize' 826x646 window direct3d debug: DirectXUpdateRects image_dst_clipped coords: 0,0,826,619 direct3d debug: DirectXUpdateRects image_src_clipped coords: 0,0,720,608 direct3d warning: trying surface pixel format: YUY2 direct3d debug: selected surface pixel format is YUY2 direct3d debug: Direct3D scene created successfully direct3d debug: Direct3D device adapter successfully initialized main debug: using vout display module "direct3d" main debug: TIMER module_need() : 180.000 ms - Total 180.000 ms / 1 intvls (Avg 180.000 ms) main debug: A filter to adapt decoder to display is needed main debug: looking for video filter2 module: 18 candidates swscale debug: 720x608 chroma: I422 -> 720x608 chroma: YUY2 with scaling using Bicubic (good quality) main debug: using video filter2 module "swscale" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: Filter 'Swscale' (06bfe680) appended to chain main debug: using video output module "vout_wrapper" main debug: TIMER module_need() : 180.000 ms - Total 180.000 ms / 1 intvls (Avg 180.000 ms) main debug: got 1 direct buffer(s) main debug: pic render sz 720x608, of (0,0), vsz 720x576, 4cc I422, sar 152:135, msk r0x0 g0x0 b0x0 main debug: pic in sz 720x608, of (0,0), vsz 720x576, 4cc I422, sar 152:135, msk r0x0 g0x0 b0x0 main debug: pic out sz 720x608, of (0,0), vsz 720x608, 4cc I422, sar 152:135, msk r0x0 g0x0 b0x0 main debug: direct render, mapping render pictures 0-23 to system pictures 1-24 main debug: looking for sub filter module: 1 candidate main debug: using sub filter module "audiobargraph_v" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: Filter 'audiobargraph_v' (06bfe9c8) appended to chain main debug: VoutDisplayEvent 'resize' 810x608 window direct3d debug: DirectXUpdateRects image_dst_clipped coords: 0,0,810,608 direct3d debug: DirectXUpdateRects image_src_clipped coords: 0,0,720,608 direct3d debug: DirectXUpdateRects image_dst_clipped coords: 0,0,810,575 direct3d debug: DirectXUpdateRects image_src_clipped coords: 0,0,720,576 direct3d debug: DirectXUpdateRects image_dst_clipped coords: 0,0,810,575 direct3d debug: DirectXUpdateRects image_src_clipped coords: 0,0,720,576 main debug: reusing aout avcodec debug: using direct rendering main info: Reparenting an object is dangerous (012fb4b0 -> 012fb678)! main debug: looking for audio output module: 4 candidates aout_directx debug: Opening DirectSound Audio Output aout_directx debug: found device: Primary Sound Driver aout_directx debug: found device: Speakers / HP (IDT High Definition Audio CODEC) main debug: End of video preroll main debug: Received first picture freetype debug: using fontsize: 38 main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed aout_directx debug: device supports 2 channels (DEFAULT!) aout_directx debug: device supports 1 channel aout_directx debug: Windows says your SpeakerConfig is stereo aout_directx debug: creating DirectSoundThread main debug: thread (DirectSound Notification Thread) created at priority 15 (../../.././modules/audio_output/directx.c:321) main debug: thread started main debug: using audio output module "aout_directx" aout_directx debug: DirectSoundThread ready main debug: TIMER module_need() : 25.000 ms - Total 25.000 ms / 1 intvls (Avg 25.000 ms) main debug: output 's16l' 48000 Hz Stereo frame=1 samples/4 bytes main debug: mixer 'f32l' 48000 Hz Stereo frame=1 samples/8 bytes main debug: filter(s) 'f32l'->'s16l' 48000 Hz->48000 Hz Stereo->Stereo main debug: looking for audio filter module: 14 candidates audio_format debug: f32l->s16l, bits per sample: 32->16 main debug: using audio filter module "audio_format" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: found a filter for the whole conversion main debug: looking for audio mixer module: 3 candidates main debug: using audio mixer module "float32_mixer" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: input 's16l' 48000 Hz Stereo frame=1 samples/4 bytes main debug: looking for audio filter module: 1 candidate scaletempo debug: format: 48000 rate, 2 nch, 4 bps, fl32 scaletempo debug: params: 30 stride, 0.200 overlap, 14 search scaletempo debug: 1.000 scale, 1440.000 stride_in, 1440 stride_out, 1152 standing, 288 overlap, 672 search, 2400 queue, fl32 mode main debug: using audio filter module "scaletempo" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: filter(s) 's16l'->'f32l' 48000 Hz->48000 Hz Stereo->Stereo main debug: looking for audio filter module: 14 candidates audio_format debug: s16l->f32l, bits per sample: 16->32 main debug: using audio filter module "audio_format" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: found a filter for the whole conversion main debug: looking for audio filter module: 1 candidate main debug: Post-processing available main debug: Detected interlaced video main debug: deinterlace 0, mode blend, is_needed 1 main warning: vlc_object_find_name(postproc) is not safe! main debug: net: connecting to localhost port 12345 main debug: connection succeeded (socket = 1564) main debug: using audio filter module "audiobargraph_a" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: filter(s) 'f32l'->'f32l' 52800 Hz->48000 Hz Stereo->Stereo main debug: accepted socket 1572 (from socket 388) main debug: looking for audio filter module: 14 candidates bandlimited_resampler debug: f32l/52800KHz/2->f32l/48000KHz/2 main debug: using audio filter module "bandlimited_resampler" main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main debug: found a filter for the whole conversion main debug: End of audio preroll main debug: Decoder buffering done in 440 ms main warning: PTS is out of range (-10000), dropping buffer main warning: PTS is out of range (-31333), dropping buffer audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000000 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000031 main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000000 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000031 audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: Destroying the input for 'V8Wipe_F.imx.mov' main debug: TIMER input launching for 'V8Wipe_F.imx.mov' : 15.000 ms - Total 15.000 ms / 1 intvls (Avg 15.000 ms) main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! main warning: vlc_object_find_name(audiobargraph_v) is not safe! audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 main warning: vlc_object_find_name(audiobargraph_v) is not safe! audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: VoutDisplayEvent 'resize' 855x608 window direct3d debug: DirectXUpdateRects image_dst_clipped coords: 0,0,855,608 direct3d debug: DirectXUpdateRects image_src_clipped coords: 0,0,720,576 main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 5.000 ms - Total 5.000 ms / 1 intvls (Avg 5.000 ms) main error: blending YUVA to I422 failed audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000031 main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 ...repeats during playing... main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000000:0.000000 main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: EOF reached main debug: pausing at EOF (pause after each) audiobargraph_a debug: message values : @audiobargraph_v audiobargraph_v-i_values 0.000031:0.000031 main warning: vlc_object_find_name(audiobargraph_v) is not safe! main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed ...many repeats... main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: incoming request - stopping current input main debug: control type=0 main debug: control: stopping input main debug: dying input main debug: dying input main debug: thread times: real 0m4.307258s, kernel 0m0.000000s, user 0m0.156001s avcodec debug: ffmpeg codec (MPEG-1/2 Video) stopped main debug: removing module "avcodec" main debug: killing decoder fourcc `mpgv', 0 PES in FIFO main debug: [0] 2 0 main debug: [1] 4 0 main debug: [2] 4 0 main debug: [3] 4 0 main debug: [4] 2 0 main debug: [5] 2 0 main debug: [6] 0 0 main debug: [7] 0 0 main debug: [8] 0 0 main debug: [9] 0 0 main debug: [10] 0 0 main debug: [11] 2 0 main debug: [12] 2 0 main debug: [13] 2 0 main debug: [14] 2 0 main debug: [15] 4 0 main debug: [16] 4 0 main debug: [17] 4 0 main debug: [18] 4 0 main debug: [19] 2 0 main debug: [20] 2 0 main debug: [21] 2 0 main debug: [22] 2 0 main debug: [23] 2 0 main debug: saving a free vout main debug: thread times: real 0m4.307258s, kernel 0m0.000000s, user 0m0.000000s main debug: removing module "araw" main debug: killing decoder fourcc `s16l', 0 PES in FIFO main debug: removing module "audio_format" main debug: removing module "scaletempo" main debug: removing module "audiobargraph_a" main debug: waitpipe: object killed main error: Read error: Connection reset by peer main debug: removing module "bandlimited_resampler" aout_directx debug: closing audio device aout_directx debug: DirectSoundThread exiting main debug: thread ended main debug: thread times: real 0m3.877233s, kernel 0m0.000000s, user 0m0.000000s main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: looking for video blending module: 1 candidate main debug: no video blending module matching "any" could be loaded main debug: TIMER module_need() : 0.000 ms - Total 0.000 ms / 1 intvls (Avg 0.000 ms) main error: blending YUVA to I422 failed main debug: removing module "aout_directx" main debug: removing module "audio_format" main debug: removing module "float32_mixer" main debug: releasing aout mp4 debug: freeing all memory mp4 warning: cannot free box mx5p, type unknown main debug: removing module "mp4" main debug: removing module "stream_filter_record" main debug: removing module "filesystem" main debug: Program doesn't contain anymore ES main debug: thread ended main debug: dead input main debug: thread times: real 0m4.347261s, kernel 0m0.031200s, user 0m0.031200s main debug: destroying useless vout main debug: Filter 06bfe680 removed from chain main debug: removing module "swscale" direct3d debug: Direct3D scene released successfully direct3d debug: DirectXEventThread terminating direct3d debug: DirectXCloseWindow direct3d debug: WinProc WM_DESTROY qt4 debug: releasing video... qt4 debug: IM: Deleting the input qt4 debug: Video is not needed anymore main debug: removing module "qt4" main debug: removing module "direct3d" main debug: removing module "vout_wrapper" main debug: removing module "freetype" main debug: removing module "yuvp" main debug: removing module "swscale" main debug: Filter 06bfe9c8 removed from chain main debug: removing module "audiobargraph_v"
See the message "main error: blending YUVA to I422 failed" - looks like blending is the issue.
I cannot set the vertical size of the bar graph, or move it up and down. It is the full height of the window and i can't change it.
Misfeature more than a bug...
OK. In the earlier screenshots posted the bars were about 1/4 the height of the video.
The bar graph audio display seems to be about 0.5 seconds in advance of the video and sound that is seen and heard. That is: sounds show up on the bar graph about 1/2 a second before they are heard. It would be nice to set the synchronisiation.
This is annoying...
Yes, understandable given how the overlay works, but would be nice to be able to delay the audio data being sent to the overlay filter.

xdzi
New Cone
New Cone
Posts: 1
Joined: 01 Jul 2011 23:23

Re: Audio and video module

Postby xdzi » 01 Jul 2011 23:27

Hello,
I would like to use same plugin with bars in my vlc. What should I do?
For me important thing is normalization in playing materials then I would like all bars set to nominal level. Are this bar is set to any level?

calanor
Blank Cone
Blank Cone
Posts: 50
Joined: 08 May 2010 19:36

Re: Audio and video module

Postby calanor » 08 May 2013 18:30

Hello,
I would like to use same plugin with bars in my vlc. What should I do?
For me important thing is normalization in playing materials then I would like all bars set to nominal level. Are this bar is set to any level?
I modified audiobargraph_v.c to display the bars in dBFS according to IEC 268-18 standard. If anyone is interested, I can send the file.


The only small problem is a kind of delay between the bar and the audio.
Does anyone know an option more direct and with least delay that rc to pass data between the audio and video filter?

Jean-Baptiste Kempf
Site Administrator
Site Administrator
Posts: 37523
Joined: 22 Jul 2005 15:29
VLC version: 4.0.0-git
Operating System: Linux, Windows, Mac
Location: Cone, France
Contact:

Re: Audio and video module

Postby Jean-Baptiste Kempf » 12 May 2013 01:51

Hello,
I would like to use same plugin with bars in my vlc. What should I do?
For me important thing is normalization in playing materials then I would like all bars set to nominal level. Are this bar is set to any level?
I modified audiobargraph_v.c to display the bars in dBFS according to IEC 268-18 standard. If anyone is interested, I can send the file.
Please send the patch.
Jean-Baptiste Kempf
http://www.jbkempf.com/ - http://www.jbkempf.com/blog/category/Videolan
VLC media player developer, VideoLAN President and Sites administrator
If you want an answer to your question, just be specific and precise. Don't use Private Messages.

calanor
Blank Cone
Blank Cone
Posts: 50
Joined: 08 May 2010 19:36

Re: Audio and video module

Postby calanor » 22 Jun 2013 18:29

For a few days the patch is already available in the latest version of git.

But audiobargraph_v module no longer works because "call_object_command" has been removed from cli.lua, (and also "object commands" from oldRc) and is required for communicate audiobargraph_a module with audiobargraph_v module via rc.

http://git.videolan.org/?p=vlc.git;a=co ... ab925a937c
http://git.videolan.org/?p=vlc.git;a=co ... 1ffb700d4e

Jean-Baptiste Kempf
Site Administrator
Site Administrator
Posts: 37523
Joined: 22 Jul 2005 15:29
VLC version: 4.0.0-git
Operating System: Linux, Windows, Mac
Location: Cone, France
Contact:

Re: Audio and video module

Postby Jean-Baptiste Kempf » 23 Jun 2013 13:19

What do you mean? audiobargraph_a and audiobargraph_v should discuss without RC.
Jean-Baptiste Kempf
http://www.jbkempf.com/ - http://www.jbkempf.com/blog/category/Videolan
VLC media player developer, VideoLAN President and Sites administrator
If you want an answer to your question, just be specific and precise. Don't use Private Messages.

ywlke
Blank Cone
Blank Cone
Posts: 24
Joined: 03 Nov 2013 18:14

Re: Audio and video module

Postby ywlke » 03 Nov 2013 18:17

Any update?

Jean-Baptiste Kempf
Site Administrator
Site Administrator
Posts: 37523
Joined: 22 Jul 2005 15:29
VLC version: 4.0.0-git
Operating System: Linux, Windows, Mac
Location: Cone, France
Contact:

Re: Audio and video module

Postby Jean-Baptiste Kempf » 21 Mar 2014 10:31

This audiobargraph is fixed in 2.2.0
Jean-Baptiste Kempf
http://www.jbkempf.com/ - http://www.jbkempf.com/blog/category/Videolan
VLC media player developer, VideoLAN President and Sites administrator
If you want an answer to your question, just be specific and precise. Don't use Private Messages.

calanor
Blank Cone
Blank Cone
Posts: 50
Joined: 08 May 2010 19:36

Re: Audio and video module

Postby calanor » 27 Mar 2014 12:58

Fantastic. But now, BarGraphCallback (audiobargraph_v.c) no longer responds to RC commands and some params can not be changed on the fly.
It could remove everything callbacks except "audiobargraph_v-alarm" and "audiobargraph_v-i_values​​" or add this commands in lua RC .

Jean-Baptiste Kempf
Site Administrator
Site Administrator
Posts: 37523
Joined: 22 Jul 2005 15:29
VLC version: 4.0.0-git
Operating System: Linux, Windows, Mac
Location: Cone, France
Contact:

Re: Audio and video module

Postby Jean-Baptiste Kempf » 22 Apr 2014 14:49

Why do you want to modify on the fly?
Jean-Baptiste Kempf
http://www.jbkempf.com/ - http://www.jbkempf.com/blog/category/Videolan
VLC media player developer, VideoLAN President and Sites administrator
If you want an answer to your question, just be specific and precise. Don't use Private Messages.


Return to “Development around libVLC”

Who is online

Users browsing this forum: No registered users and 30 guests