Trouble decoding using OpenMAX

[kripton]

Hi there,
I'm running Gentoo-Linux on the Raspberry Pi (ARMv6, hardfloat-ABI). Since I read that VLC supports OpenMAX IL for decoding, I wanted to try it on the board (where the GPU can decode MP3 and H.264). Using the omxplayer from https://github.com/huceke/omxplayer playback of an MP3-file works:

Code: Select all

rpi-dev omxplayer # LD_LIBRARY_PATH=/opt/vc/lib ./omxplayer /home/rpi/01\ -\ Barfuss.mp3 [mp3 @ 0x1e43060] max_analyze_duration 5000000 reached at 5015510 file : /home/rpi/01 - Barfuss.mp3 reult 0 format mp3 audio streams 1 video streams 0 chapters 0 subtitles 0 Audio codec mp3 channels 2 samplerate 44100 bitspersample 16

omxplayer seems to rely on ffmpeg for file information and demuxing but leaves decoding and playback to OpenMAX (so no ALSA involved here).

I built VLC with the "omxil" USE-flag and the module-list shows me that the decoder exists (in the list on the GUI it has score 80):

Code: Select all

rpi-dev ~ # LD_LIBRARY_PATH=/opt/vc/lib cvlc -l | grep -i openmax VLC media player 2.0.1 Twoflower (revision 2.0.1-0-gf432547) omxil Audio/Video decoder (using OpenMAX IL) omxil Video encoder (using OpenMAX IL)

However when trying to play that same file with VLC, it tries to use the "mpeg_audio" decoder and not the OpenMAX one (please ignore everything related to ALSA here):

Code: Select all

rpi-dev ~ # cat vlc-mpegaudio-noomx.log main debug: adding item `01 - Barfuss.mp3' ( file:///home/rpi/01%20-%20Barfuss.mp3 ) main debug: rebuilding array of current - root Playlist main debug: rebuild done - 1 items, index -1 main debug: processing request item: 01 - Barfuss.mp3, node: null, skip: 0 main debug: resyncing on 01 - Barfuss.mp3 main debug: 01 - Barfuss.mp3 is at 0 main debug: starting playback of the new playlist item main debug: creating new input thread main debug: Creating an input for '01 - Barfuss.mp3' qt4 debug: Adding a new MRL to recent ones: file:///home/rpi/01%20-%20Barfuss.mp3 main debug: Creating an input for '01 - Barfuss.mp3' main debug: using timeshift granularity of 50 MiB, in path '/tmp' main debug: `file:///home/rpi/01%20-%20Barfuss.mp3' gives access `file' demux `' path `/home/rpi/01%20-%20Barfuss.mp3' main debug: creating demux: access='file' demux='' location='/home/rpi/01%20-%20Barfuss.mp3' file='/home/rpi/01 - Barfuss.mp3' main debug: looking for access_demux module: 1 candidate main debug: no access_demux module matching "file" could be loaded main debug: TIMER module_need() : 0.861 ms - Total 0.861 ms / 1 intvls (Avg 0.861 ms) main debug: creating access 'file' location='/home/rpi/01%20-%20Barfuss.mp3', path='/home/rpi/01 - Barfuss.mp3' main debug: looking for access module: 2 candidates filesystem debug: opening file `/home/rpi/01 - Barfuss.mp3' main debug: using access module "filesystem" main debug: TIMER module_need() : 0.909 ms - Total 0.909 ms / 1 intvls (Avg 0.909 ms) main debug: Using stream method for AStream* main debug: starting pre-buffering main debug: received first data after 0 ms main debug: pre-buffering done 1024 bytes in 0s - 6944 KiB/s main debug: looking for stream_filter module: 7 candidates main debug: no stream_filter module matching "any" could be loaded main debug: TIMER module_need() : 0.767 ms - Total 0.767 ms / 1 intvls (Avg 0.767 ms) main debug: looking for stream_filter module: 1 candidate main debug: using stream_filter module "stream_filter_record" main debug: TIMER module_need() : 0.674 ms - Total 0.674 ms / 1 intvls (Avg 0.674 ms) main debug: creating demux: access='file' demux='' location='/home/rpi/01%20-%20Barfuss.mp3' file='/home/rpi/01 - Barfuss.mp3' main debug: ID3v2.3 revision 0 tag found, skipping 53306 bytes main debug: looking for demux module: 48 candidates es debug: xing vbr value present (77) es debug: xing frames&bytes value present (3734708 bytes, 6077 frames, 1152 samples/frame) es debug: detected format mpga main debug: looking for packetizer module: 19 candidates main debug: meta ok for (null), need to fetch art main debug: using packetizer module "mpeg_audio" main debug: TIMER module_need() : 76.214 ms - Total 76.214 ms / 1 intvls (Avg 76.214 ms) mpeg_audio debug: MPGA channels:2 samplerate:44100 bitrate:128 main debug: selecting program id=0 main debug: using demux module "es" main debug: TIMER module_need() : 124.817 ms - Total 124.817 ms / 1 intvls (Avg 124.817 ms) main debug: looking for a subtitle file in /home/rpi main debug: looking for decoder module: 24 candidates main debug: using decoder module "mpeg_audio" main debug: TIMER module_need() : 2.481 ms - Total 2.481 ms / 1 intvls (Avg 2.481 ms) main debug: looking for meta fetcher module: 0 candidates main debug: no meta fetcher module matched "any" main debug: TIMER module_need() : 0.750 ms - Total 0.750 ms / 1 intvls (Avg 0.750 ms) main debug: searching art for 01 - Barfuss.mp3 main debug: looking for art finder module: 1 candidate main debug: looking for meta reader module: 0 candidates main debug: no meta reader module matched "any" main debug: TIMER module_need() : 0.724 ms - Total 0.724 ms / 1 intvls (Avg 0.724 ms) main debug: `file:///home/rpi/01%20-%20Barfuss.mp3' successfully opened main debug: Buffering 0% main debug: Buffering 8% mpeg_audio debug: MPGA channels:2 samplerate:44100 bitrate:128 main debug: creating audio output main debug: looking for audio output module: 1 candidate alsa debug: keeping 2 channels main debug: Buffering 17% main debug: Buffering 26% main debug: Buffering 34% main debug: Buffering 43% main debug: Buffering 52% main debug: Buffering 60% main debug: Buffering 69% main debug: Buffering 78% main debug: Buffering 87% main debug: Buffering 95% main debug: Stream buffering done (313 ms in 6 ms) main debug: no art finder module matching "any" could be loaded main debug: TIMER module_need() : 14.925 ms - Total 14.925 ms / 1 intvls (Avg 14.925 ms) main debug: art not found for 01 - Barfuss.mp3 alsa debug: using ALSA device: default alsa debug: Plug PCM: Hardware PCM card 0 'bcm2835 ALSA' device 0 subdevice 0 alsa debug: device name : bcm2835 ALSA alsa debug: device ID : bcm2835 ALSA alsa debug: subdevice name: subdevice #0 alsa debug: initial hardware setup: ACCESS: MMAP_INTERLEAVED MMAP_NONINTERLEAVED MMAP_COMPLEX RW_INTERLEAVED RW_NONINTERLEAVED FORMAT: S8 U8 S16_LE S16_BE U16_LE U16_BE S24_LE S24_BE U24_LE U24_BE S32_LE S32_BE U32_LE U32_BE FLOAT_LE FLOAT_BE FLOAT64_LE FLOAT64_BE MU_LAW A_LAW IMA_ADPCM S24_3LE S24_3BE U24_3LE U24_3BE S20_3LE S20_3BE U20_3LE U20_3BE S18_3LE S18_3BE U18_3LE U18_3BE SUBFORMAT: STD SAMPLE_BITS: [4 64] FRAME_BITS: [4 640000] CHANNELS: [1 10000] RATE: [8000 48000] PERIOD_TIME: (5333 3968000] PERIOD_SIZE: [256 31744] PERIOD_BYTES: [128 2539520000] PERIODS: (0 124] BUFFER_TIME: (5333 3968000] BUFFER_SIZE: [256 31744] BUFFER_BYTES: [128 2539520000] TICK_TIME: ALL alsa error: cannot commit hardware parameters: Invalid argument main debug: no audio output module matching "any" could be loaded main debug: TIMER module_need() : 135.123 ms - Total 135.123 ms / 1 intvls (Avg 135.123 ms) main error: no suitable audio output module main debug: releasing audio output main error: failed to create audio output main debug: Decoder buffering done in 138 ms qt4 debug: IM: Setting an input main debug: incoming request - stopping current input main debug: dying input main debug: control: stopping input main debug: dying input main debug: removing module "mpeg_audio" main debug: killing decoder fourcc `mpga', 0 PES in FIFO main debug: removing module "es" main debug: removing module "mpeg_audio" main debug: removing module "stream_filter_record" main debug: removing module "filesystem" main debug: Program doesn't contain anymore ES main debug: dead input qt4 debug: IM: Deleting the input main debug: TIMER input launching for '01 - Barfuss.mp3' : 189.612 ms - Total 189.612 ms / 1 intvls (Avg 189.612 ms)

Is there a reason why OpenMAX is not used? Is it a configuration or coding problem (bug)?

[Jean-Baptiste Kempf]

because I believe libmad is higher in priority.
Try --codec omxil

[kripton]

Thanks for your answer. I'm afraid it still uses mpeg_audio as decoder:

Code: Select all

rpi-dev ~ # LD_LIBRARY_PATH=/opt/vc/lib cvlc --verbose 2 --codec omxil /home/rpi/01\ -\ Barfuss.mp3 VLC media player 2.0.1 Twoflower (revision 2.0.1-0-gf432547) [0x11f50c8] main libvlc debug: VLC media player - 2.0.1 Twoflower [0x11f50c8] main libvlc debug: Copyright © 1996-2012 VLC authors and VideoLAN [0x11f50c8] main libvlc debug: revision 2.0.1-0-gf432547 [0x11f50c8] main libvlc debug: configured with ./configure '--prefix=/usr' '--build=armv6j-hardfloat-linux-gnueabi' '--host=armv6j-hardfloat-linux-gnueabi' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--datadir=/usr/share' '--sysconfdir=/etc' '--localstatedir=/var/lib' '--disable-dependency-tracking' '--docdir=/usr/share/doc/vlc-2.0.1' '--disable-a52' '--disable-aa' '--enable-faad' '--enable-alsa' '--disable-altivec' '--disable-atmo' '--disable-audioqueue' '--disable-bonjour' '--enable-avcodec' '--enable-avformat' '--disable-fribidi' '--disable-bluray' '--disable-vcd' '--disable-libcddb' '--disable-dbus' '--disable-dbus-control' '--disable-dirac' '--disable-direct2d' '--enable-directfb' '--disable-directx' '--disable-dc1394' '--disable-debug' '--disable-dshow' '--disable-dca' '--enable-dvbpsi' '--disable-dvdread' '--disable-dvdnav' '--disable-dxva2' '--enable-egl' '--disable-sout' '--disable-fbosd' '--disable-flac' '--disable-fluidsynth' '--disable-fontconfig' '--enable-libgcrypt' '--disable-gme' '--disable-gnomevfs' '--disable-gnutls' '--disable-growl' '--disable-httpd' '--disable-dv' '--disable-ios-vout' '--disable-jack' '--disable-kate' '--without-kde-solid' '--disable-libass' '--disable-caca' '--disable-notify' '--disable-libproxy' '--disable-samplerate' '--disable-libtar' '--disable-tiger' '--disable-linsys' '--disable-lirc' '--disable-live555' '--disable-lua' '--disable-macosx-audio' '--disable-macosx-dialog-provider' '--disable-macosx-eyetv' '--disable-macosx-qtkit' '--disable-macosx-quartztext' '--disable-macosx-vout' '--disable-mkv' '--disable-media-library' '--disable-mmx' '--disable-mod' '--enable-mad' '--enable-libmpeg2' '--disable-mtp' '--disable-mpc' '--enable-ncurses' '--disable-neon' '--enable-ogg' '--enable-omxil' '--disable-glx' '--disable-optimize-memory' '--disable-oss' '--disable-png' '--disable-portaudio' '--enable-postproc' '--disable-projectm' '--disable-pulse' '--disable-pvr' '--enable-qt4' '--disable-realrtsp' '--enable-run-as-root' '--disable-smb' '--disable-schroedinger' '--disable-sdl' '--disable-sdl-image' '--disable-shine' '--disable-sid' '--disable-shout' '--disable-skins2' '--disable-speex' '--disable-sqlite' '--disable-sse' '--disable-svg' '--disable-switcher' '--enable-swscale' '--disable-taglib' '--enable-theora' '--disable-freetype' '--disable-twolame' '--disable-udev' '--disable-upnp' '--disable-v4l2' '--disable-libva' '--disable-vcdx' '--disable-vlm' '--enable-vorbis' '--disable-waveout' '--disable-loader' '--disable-wingdi' '--disable-wma-fixed' '--with-x' '--disable-x264' '--enable-xcb' '--disable-libxml2' '--disable-xosd' '--disable-xvideo' '--disable-zvbi' '--enable-telx' '--disable-optimizations' '--without-tuning' '--enable-fast-install' 'build_alias=armv6j-hardfloat-linux-gnueabi' 'host_alias=armv6j-hardfloat-linux-gnueabi' 'CFLAGS=-O2 -mcpu=arm1176jzf-s -mfpu=vfp -mfloat-abi=hard -pipe -fomit-frame-pointer' 'LDFLAGS=-Wl,-O1 -Wl,--as-needed' 'CXXFLAGS=-O2 -mcpu=arm1176jzf-s -mfpu=vfp -mfloat-abi=hard -pipe -fomit-frame-pointer' [0x11f50c8] main libvlc debug: searching plug-in modules [0x11f50c8] main libvlc debug: loading plugins cache file /usr/lib/vlc/plugins/plugins.dat [0x11f50c8] main libvlc debug: recursively browsing `/usr/lib/vlc/plugins' [0x11f50c8] main libvlc debug: saving plugins cache /usr/lib/vlc/plugins/plugins.dat [0x11f50c8] main libvlc debug: plug-ins loaded: 276 modules [0x11f50c8] main libvlc debug: opening config file (/root/.config/vlc/vlcrc) [0x11f50c8] main libvlc debug: translation test: code is "C" [0x11f50c8] main libvlc debug: CPU has capabilities FPU [0x11f50c8] main libvlc debug: looking for memcpy module: 1 candidate [0x11f50c8] main libvlc debug: using memcpy module "memcpy" [0x12565a8] main input debug: Creating an input for 'Media Library' [0x12565a8] main input debug: Input is a meta file: disabling unneeded options [0x12565a8] main input debug: using timeshift granularity of 50 MiB, in path '/tmp' [0x12565a8] main input debug: `file/xspf-open:///root/.local/share/vlc/ml.xspf' gives access `file' demux `xspf-open' path `/root/.local/share/vlc/ml.xspf' [0x12565a8] main input debug: creating demux: access='file' demux='xspf-open' location='/root/.local/share/vlc/ml.xspf' file='/root/.local/share/vlc/ml.xspf' [0x125a2d8] main demux debug: looking for access_demux module: 1 candidate [0x125a2d8] main demux debug: no access_demux module matching "file" could be loaded [0x125a2d8] main demux debug: TIMER module_need() : 5.971 ms - Total 5.971 ms / 1 intvls (Avg 5.971 ms) [0x12565a8] main input debug: creating access 'file' location='/root/.local/share/vlc/ml.xspf', path='/root/.local/share/vlc/ml.xspf' [0x125a660] main access debug: looking for access module: 2 candidates [0x125a660] filesystem access debug: opening file `/root/.local/share/vlc/ml.xspf' [0x125a660] main access debug: using access module "filesystem" [0x125a660] main access debug: TIMER module_need() : 9.395 ms - Total 9.395 ms / 1 intvls (Avg 9.395 ms) [0x125a2d8] main stream debug: Using stream method for AStream* [0x125a2d8] main stream debug: starting pre-buffering [0x125a2d8] main stream debug: received first data after 0 ms [0x125a2d8] main stream debug: pre-buffering done 296 bytes in 0s - 298 KiB/s [0x125b6e8] main stream debug: looking for stream_filter module: 7 candidates [0x125b6e8] main stream debug: no stream_filter module matching "any" could be loaded [0x125b6e8] main stream debug: TIMER module_need() : 33.788 ms - Total 33.788 ms / 1 intvls (Avg 33.788 ms) [0x125b6e8] main stream debug: looking for stream_filter module: 1 candidate [0x125b6e8] main stream debug: using stream_filter module "stream_filter_record" [0x125b6e8] main stream debug: TIMER module_need() : 5.716 ms - Total 5.716 ms / 1 intvls (Avg 5.716 ms) [0x12565a8] main input debug: creating demux: access='file' demux='xspf-open' location='/root/.local/share/vlc/ml.xspf' file='/root/.local/share/vlc/ml.xspf' [0x125c208] main demux debug: looking for demux module: 1 candidate [0x125c208] playlist demux debug: using XSPF playlist reader [0x125c208] main demux debug: using demux module "playlist" [0x125c208] main demux debug: TIMER module_need() : 7.524 ms - Total 7.524 ms / 1 intvls (Avg 7.524 ms) [0x124da58] main demux meta debug: looking for meta reader module: 0 candidates [0x124da58] main demux meta debug: no meta reader module matched "any" [0x124da58] main demux meta debug: TIMER module_need() : 3.463 ms - Total 3.463 ms / 1 intvls (Avg 3.463 ms) [0x12565a8] main input debug: `file/xspf-open:///root/.local/share/vlc/ml.xspf' successfully opened [0x125c2d0] main xml reader debug: looking for xml reader module: 0 candidates [0x125c2d0] main xml reader debug: no xml reader module matched "any" [0x125c2d0] main xml reader debug: TIMER module_need() : 2.086 ms - Total 2.086 ms / 1 intvls (Avg 2.086 ms) [0x125c2d0] main xml reader error: XML reader not found [0x125c208] main demux debug: removing module "playlist" [0x125b6e8] main stream debug: removing module "stream_filter_record" [0x125a660] main access debug: removing module "filesystem" [0x12565a8] main input debug: TIMER input launching for 'Media Library' : 91.863 ms - Total 91.863 ms / 1 intvls (Avg 91.863 ms) [0x125b6e8] main interface debug: looking for interface module: 1 candidate [0x125b6e8] main interface debug: using interface module "hotkeys" [0x125b6e8] main interface debug: TIMER module_need() : 7.192 ms - Total 7.192 ms / 1 intvls (Avg 7.192 ms) [0x1203fc0] main playlist debug: playlist threads correctly activated [0x1203fc0] main playlist debug: adding item `01 - Barfuss.mp3' ( file:///home/rpi/01%20-%20Barfuss.mp3 ) [0x1257228] main interface debug: looking for interface module: 1 candidate [0x1203fc0] main playlist debug: rebuilding array of current - root Playlist [0x1203fc0] main playlist debug: rebuild done - 1 items, index -1 [0x125a660] main input debug: Creating an input for '01 - Barfuss.mp3' [0x1257228] main interface debug: using interface module "globalhotkeys" [0x1257228] main interface debug: TIMER module_need() : 29.290 ms - Total 29.290 ms / 1 intvls (Avg 29.290 ms) [0x1251678] main interface debug: looking for interface module: 1 candidate [0x1251678] dummy interface: using the dummy interface module... [0x1251678] main interface debug: using interface module "dummy" [0x1251678] main interface debug: TIMER module_need() : 6.911 ms - Total 6.911 ms / 1 intvls (Avg 6.911 ms) [0x1203fc0] main playlist debug: processing request item: null, node: Playlist, skip: 0 [0x1203fc0] main playlist debug: starting playback of the new playlist item [0x1203fc0] main playlist debug: creating new input thread [0x12522c8] main input debug: Creating an input for '01 - Barfuss.mp3' [0x12522c8] main input debug: using timeshift granularity of 50 MiB, in path '/tmp' [0x12522c8] main input debug: `file:///home/rpi/01%20-%20Barfuss.mp3' gives access `file' demux `' path `/home/rpi/01%20-%20Barfuss.mp3' [0x12522c8] main input debug: creating demux: access='file' demux='' location='/home/rpi/01%20-%20Barfuss.mp3' file='/home/rpi/01 - Barfuss.mp3' [0x1263be8] main demux debug: looking for access_demux module: 1 candidate [0x1263be8] main demux debug: no access_demux module matching "file" could be loaded [0x1263be8] main demux debug: TIMER module_need() : 2.139 ms - Total 2.139 ms / 1 intvls (Avg 2.139 ms) [0x12522c8] main input debug: creating access 'file' location='/home/rpi/01%20-%20Barfuss.mp3', path='/home/rpi/01 - Barfuss.mp3' [0x1263be8] main access debug: looking for access module: 2 candidates [0x1263be8] filesystem access debug: opening file `/home/rpi/01 - Barfuss.mp3' [0x1263be8] main access debug: using access module "filesystem" [0x1263be8] main access debug: TIMER module_need() : 3.043 ms - Total 3.043 ms / 1 intvls (Avg 3.043 ms) [0x1263d38] main stream debug: Using stream method for AStream* [0x1263d38] main stream debug: starting pre-buffering [0x1263d38] main stream debug: received first data after 0 ms [0x1263d38] main stream debug: pre-buffering done 1024 bytes in 0s - 2976 KiB/s [0x1263ef8] main stream debug: looking for stream_filter module: 7 candidates [0x1263ef8] main stream debug: no stream_filter module matching "any" could be loaded [0x1263ef8] main stream debug: TIMER module_need() : 5.414 ms - Total 5.414 ms / 1 intvls (Avg 5.414 ms) [0x1263ef8] main stream debug: looking for stream_filter module: 1 candidate [0x1263ef8] main stream debug: using stream_filter module "stream_filter_record" [0x1263ef8] main stream debug: TIMER module_need() : 2.515 ms - Total 2.515 ms / 1 intvls (Avg 2.515 ms) [0x12522c8] main input debug: creating demux: access='file' demux='' location='/home/rpi/01%20-%20Barfuss.mp3' file='/home/rpi/01 - Barfuss.mp3' [0x1264410] main demux debug: ID3v2.3 revision 0 tag found, skipping 53306 bytes [0x1264410] main demux debug: looking for demux module: 48 candidates [0x1264410] es demux debug: xing vbr value present (77) [0x1203fc0] main playlist debug: meta ok for (null), need to fetch art [0x1264410] es demux debug: xing frames&bytes value present (3734708 bytes, 6077 frames, 1152 samples/frame) [0x1264410] es demux debug: detected format mpga [0x1259ab8] main demux packetizer debug: looking for packetizer module: 19 candidates [0x1259ab8] main demux packetizer debug: using packetizer module "mpeg_audio" [0x1259ab8] main demux packetizer debug: TIMER module_need() : 2.821 ms - Total 2.821 ms / 1 intvls (Avg 2.821 ms) [0x1259ab8] mpeg_audio demux packetizer debug: MPGA channels:2 samplerate:44100 bitrate:128 [0x12522c8] main input debug: selecting program id=0 [0x125a2a0] main demux meta debug: looking for meta fetcher module: 0 candidates [0x125a2a0] main demux meta debug: no meta fetcher module matched "any" [0x125a2a0] main demux meta debug: TIMER module_need() : 4.963 ms - Total 4.963 ms / 1 intvls (Avg 4.963 ms) [0x1203fc0] main playlist debug: searching art for 01 - Barfuss.mp3 [0x125a2a0] main art finder debug: looking for art finder module: 1 candidate [0x125a2a0] main art finder debug: no art finder module matching "any" could be loaded [0x1264410] main demux debug: using demux module "es" [0x1264410] main demux debug: TIMER module_need() : 32.250 ms - Total 32.250 ms / 1 intvls (Avg 32.250 ms) [0x12522c8] main input debug: looking for a subtitle file in /home/rpi [0x1259e10] main decoder debug: looking for decoder module: 24 candidates [0x1259e10] main decoder debug: using decoder module "mpeg_audio" [0x125a2a0] main art finder debug: TIMER module_need() : 8.503 ms - Total 8.503 ms / 1 intvls (Avg 8.503 ms) [0x1203fc0] main playlist debug: art not found for 01 - Barfuss.mp3 [0x1259e10] main decoder debug: TIMER module_need() : 8.260 ms - Total 8.260 ms / 1 intvls (Avg 8.260 ms) [0x1259800] main demux meta debug: looking for meta reader module: 0 candidates [0x1259800] main demux meta debug: no meta reader module matched "any" [0x1259800] main demux meta debug: TIMER module_need() : 2.177 ms - Total 2.177 ms / 1 intvls (Avg 2.177 ms) [0x12522c8] main input debug: `file:///home/rpi/01%20-%20Barfuss.mp3' successfully opened [0x12522c8] main input debug: Buffering 0% [0x12522c8] main input debug: Buffering 8% [0x12522c8] main input debug: Buffering 17% [0x1259e10] mpeg_audio decoder debug: MPGA channels:2 samplerate:44100 bitrate:128 [0x1203fc0] main playlist debug: creating audio output [0x1250008] main audio output debug: looking for audio output module: 1 candidate [0x12522c8] main input debug: Buffering 26% [0x12522c8] main input debug: Buffering 34% [0x12522c8] main input debug: Buffering 43% [0x12522c8] main input debug: Buffering 52% [0x12522c8] main input debug: Buffering 60% [0x12522c8] main input debug: Buffering 69% [0x12522c8] main input debug: Buffering 78% [0x1250008] alsa audio output debug: keeping 2 channels [0x12522c8] main input debug: Buffering 87% [0x12522c8] main input debug: Buffering 95% [0x12522c8] main input debug: Stream buffering done (313 ms in 26 ms) [0x1250008] alsa audio output debug: using ALSA device: default [0x1250008] alsa audio output debug: Plug PCM: Hardware PCM card 0 'bcm2835 ALSA' device 0 subdevice 0 [0x1250008] alsa audio output debug: device name : bcm2835 ALSA [0x1250008] alsa audio output debug: device ID : bcm2835 ALSA [0x1250008] alsa audio output debug: subdevice name: subdevice #0 [0x1250008] alsa audio output debug: initial hardware setup: ACCESS: MMAP_INTERLEAVED MMAP_NONINTERLEAVED MMAP_COMPLEX RW_INTERLEAVED RW_NONINTERLEAVED FORMAT: S8 U8 S16_LE S16_BE U16_LE U16_BE S24_LE S24_BE U24_LE U24_BE S32_LE S32_BE U32_LE U32_BE FLOAT_LE FLOAT_BE FLOAT64_LE FLOAT64_BE MU_LAW A_LAW IMA_ADPCM S24_3LE S24_3BE U24_3LE U24_3BE S20_3LE S20_3BE U20_3LE U20_3BE S18_3LE S18_3BE U18_3LE U18_3BE SUBFORMAT: STD SAMPLE_BITS: [4 64] FRAME_BITS: [4 640000] CHANNELS: [1 10000] RATE: [8000 48000] PERIOD_TIME: (5333 3968000] PERIOD_SIZE: [256 31744] PERIOD_BYTES: [128 2539520000] PERIODS: (0 124] BUFFER_TIME: (5333 3968000] BUFFER_SIZE: [256 31744] BUFFER_BYTES: [128 2539520000] TICK_TIME: ALL [0x1250008] alsa audio output error: cannot commit hardware parameters: Invalid argument [0x1250008] main audio output debug: no audio output module matching "any" could be loaded [0x1250008] main audio output debug: TIMER module_need() : 59.680 ms - Total 59.680 ms / 1 intvls (Avg 59.680 ms) [0x1250008] main audio output error: no suitable audio output module [0x1203fc0] main playlist debug: releasing audio output [0x1259e10] main decoder error: failed to create audio output [0x12522c8] main input debug: Decoder buffering done in 41 ms ^C[0x11f50c8] main libvlc debug: deactivating the playlist [0x1203fc0] main playlist debug: deactivating the playlist [0x1203fc0] main playlist debug: incoming request - stopping current input [0x1203fc0] main playlist debug: dying input [0x12522c8] main input debug: control: stopping input [0x1203fc0] main playlist debug: dying input [0x1259e10] main decoder debug: removing module "mpeg_audio" [0x1259e10] main decoder debug: killing decoder fourcc `mpga', 0 PES in FIFO [0x1264410] main demux debug: removing module "es" [0x1259ab8] main demux packetizer debug: removing module "mpeg_audio" [0x1263ef8] main stream debug: removing module "stream_filter_record" [0x1263be8] main access debug: removing module "filesystem" [0x12522c8] main input debug: Program doesn't contain anymore ES [0x1203fc0] main playlist debug: dead input [0x12522c8] main input debug: TIMER input launching for '01 - Barfuss.mp3' : 85.978 ms - Total 85.978 ms / 1 intvls (Avg 85.978 ms) [0x12738d8] main playlist export debug: saving Media Library to file /root/.local/share/vlc/ml.xspf [0x12738d8] main playlist export debug: looking for playlist export module: 1 candidate [0x12738d8] main playlist export debug: using playlist export module "export" [0x12738d8] main playlist export debug: TIMER module_need() : 2.228 ms - Total 2.228 ms / 1 intvls (Avg 2.228 ms) [0x12738d8] main playlist export debug: removing module "export" [0x1203fc0] main playlist debug: playlist correctly deactivated [0x11f50c8] main libvlc debug: removing all services discovery tasks [0x11f50c8] main libvlc debug: removing all interfaces [0x11f50c8] main libvlc debug: exiting [0x1251678] main interface debug: removing module "dummy" [0x1257228] main interface debug: removing module "globalhotkeys" [0x125b6e8] main interface debug: removing module "hotkeys" [0x1203fc0] main playlist debug: destroying [0x11f50c8] main libvlc debug: TIMER ML Load : Total 103.275 ms / 1 intvls (Avg 103.275 ms) [0x11f50c8] main libvlc debug: TIMER Items array build : Total 3.549 ms / 1 intvls (Avg 3.549 ms) [0x11f50c8] main libvlc debug: TIMER Preparse run : Total 92.405 ms / 1 intvls (Avg 92.405 ms) [0x11f50c8] main libvlc debug: TIMER ML Dump : Total 4.708 ms / 1 intvls (Avg 4.708 ms) [0x11f50c8] main libvlc debug: removing stats [0x11f50c8] main libvlc debug: removing module "memcpy"

Maybe the OpenMAX-plugin just feels not responsible for this type of content? According to strace it is probed:

Code: Select all

... [pid 6701] write(2, "main decoder debug: \33[0m", 24main decoder debug: ) = 24 [pid 6701] write(2, "looking for decoder module: 24 c"..., 41looking for decoder module: 24 candidates) = 41 [pid 6701] write(2, "\33[0m\n", 5 ) = 5 [pid 6701] open("/usr/lib/vlc/plugins/codec/libomxil_plugin.so", O_RDONLY) = 4 [pid 6701] read(4, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0(\0\1\0\0\0|\17\0\0004\0\0\0"..., 512) = 512 [pid 6701] fstat64(4, {st_mode=S_IFREG|0755, st_size=34228, ...}) = 0 [pid 6701] mmap2(NULL, 65792, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 4, 0) = 0x409ba000 [pid 6701] mprotect(0x409c2000, 28672, PROT_NONE) = 0 [pid 6701] mmap2(0x409c9000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 4, 0x7) = 0x409c9000 [pid 6701] close(4) = 0 [pid 6701] mprotect(0x409c9000, 4096, PROT_READ) = 0 [pid 6701] open("/usr/lib/vlc/plugins/codec/libcdg_plugin.so", O_RDONLY) = 4 [pid 6701] read(4, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0(\0\1\0\0\0\220\4\0\0004\0\0\0"..., 512) = 512 [pid 6701] fstat64(4, {st_mode=S_IFREG|0755, st_size=9460, ...}) = 0 [pid 6701] mmap2(NULL, 41020, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 4, 0) = 0x409cb000 [pid 6701] mprotect(0x409cd000, 28672, PROT_NONE) = 0 [pid 6701] mmap2(0x409d4000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 4, 0x1) = 0x409d4000 [pid 6701] close(4) = 0 [pid 6701] mprotect(0x409d4000, 4096, PROT_READ) = 0 [pid 6701] write(2, "[\33[32;1m0x1417b40\33[0m] ", 23[0x1417b40] ) = 23 [pid 6701] write(2, "main decoder debug: \33[0m", 24main decoder debug: ) = 24 [pid 6701] write(2, "using decoder module \"mpeg_audio"..., 33using decoder module "mpeg_audio") = 33 [pid 6701] write(2, "\33[0m\n", 5 ) = 5 [pid 6701] clock_gettime(CLOCK_MONOTONIC, {15380, 140372002}) = 0 [pid 6701] write(2, "[\33[32;1m0x1417b40\33[0m] ", 23[0x1417b40] ) = 23 [pid 6701] write(2, "main decoder debug: \33[0m", 24main decoder debug: ) = 24 [pid 6701] write(2, "TIMER module_need() : 25.999 ms "..., 76TIMER module_need() : 25.999 ms - Total 25.999 ms / 1 intvls (Avg 25.999 ms)) = 76 [pid 6701] write(2, "\33[0m\n", 5 ) = 5 [pid 6701] rt_sigprocmask(SIG_BLOCK, [INT QUIT PIPE TERM], [HUP INT QUIT PIPE TERM CHLD], 8) = 0 [pid 6701] clone(Process 6702 attached ...

[kripton]

Okay, for completeness I tried a video that plays fine using omxplayer (so can be decoded and played back by the used GPU and the provided libraries):

Code: Select all

rpi-dev ~ # LD_LIBRARY_PATH=/opt/vc/lib cvlc --verbose 2 --codec omxil /home/rpi/Piraten_in_der_Politik_12.01.23_22-45_ard_45_TVOON_DE.mpg.avi ... [0x1a7b918] main decoder debug: looking for decoder module: 24 candidates [0x1a7b918] avcodec decoder debug: libavcodec initialized (interface 0x353d64) [0x1a7b918] avcodec decoder debug: trying to use direct rendering [0x1a7b918] avcodec decoder debug: allowing 1 thread(s) for decoding [0x1a7b918] avcodec decoder debug: ffmpeg codec (MPEG-4 Video) started [0x1a7b918] main decoder debug: using decoder module "avcodec" [0x1a7b918] main decoder debug: TIMER module_need() : 92.277 ms - Total 92.277 ms / 1 intvls (Avg 92.277 ms) [0x1a823d8] main decoder debug: looking for decoder module: 24 candidates [0x1a823d8] main decoder debug: using decoder module "mpeg_audio" ...

[Jean-Baptiste Kempf]

It does not even try to use omxil... Add debug info in the opening functions then.

[Desintegr]

Hi !

I have just bought a Raspberry Pi and I'm very interested in playing video with VLC on it.

I have looked into kripton issue.
I think the problem is VLC is not loading the right .so file for OMX decoding on the Raspberry Pi.

In omxil.c (VLC module) [1], there is :

Code: Select all

62 static const char *ppsz_dll_list[] = 63 { 64 #if defined(USE_IOMX) 65 "libiomx.so", /* Not used when using IOMX, the lib should already be loaded */ 66 #else 67 "libOMX_Core.so", /* TI OMAP IL core */ 68 "libOmxCore.so", /* Qualcomm IL core */ 69 "libomxil-bellagio.so", /* Bellagio IL core */ 70 #endif 71 0 72 };

The omxil module look for a .so file named libOMX_Core.so, libOmxCore.so or libomxil-bellagio.so but on the Raspberry Pi, the lib is named libopenmaxil.so [2].

Try to modify the ppsz_dll_list const with "libopenmaxil.so" then recompile VLC.
Or create a symbolic link for libopenmaxil.so with one of the three hard-coded name in omxil.c file.

I don't know if this will fix the problem but I will try this soon on my Raspberry Pi !

[1] http://repo.or.cz/w/vlc.git/blob/HEAD:/ ... il/omxil.c
[2] https://github.com/raspberrypi/firmware ... opt/vc/lib

[kripton]

Thanks for that nice tip. It still does not work but it changes VLC's output a little:

Code: Select all

... [0xcd2dc0] main decoder debug: looking for decoder module: 24 candidates [0xcd2dc0] omxil decoder debug: fmt in:mp4v, out: [0xcd2dc0] omxil decoder warning: OMX_Init failed (80001009: OMX_ErrorHardware) [0xcd2dc0] avcodec decoder debug: libavcodec initialized (interface 0x353d64) [0xcd2dc0] avcodec decoder debug: trying to use direct rendering [0xcd2dc0] avcodec decoder debug: allowing 1 thread(s) for decoding [0xcd2dc0] avcodec decoder debug: ffmpeg codec (MPEG-4 Video) started ...

[Desintegr]

I think the omxil module in VLC needs some tweaks before it can be used with the Raspberry Pi.

I looked in video.c example [1] provided with the firmware.
There is a call to a bcm_host_init function at the start of the main method.

According to this page [2], on the Raspberry Pi, you must use the bcm_host_init function before any GPU call :

The Raspberry Pi requires that the bcm_host_init() function is called first before any GPU calls can be made.

The omxil.c does not use this function and I think this is why you get the OMX_ErrorHardware error.

You can try to add the call to bcm_host_init() before the call to OMX_Init in the omxil then recompile the omxil module linked to libbcm_host.so.
But I think the omxil needs more tweaks than this.

[1] https://github.com/raspberrypi/firmware ... eo/video.c
[2] http://elinux.org/RPi_VideoCore_APIs

[Rémi Denis-Courmont]

That would be totally against the OpenMAX specification. And since OpenMAX is all based on run-time linking, this is not even possible.

bcm_host_init() has to be called by the OpenMAX library, not by the program that uses the OpenMAX library.

[edwardw]

Well, to be honest, I think that the omxil in VLC was more designed for mobile platforms (namely Android / iOS / etc) rather than a desktop VLC, which is why there might be so many incompatibilities arising.

[ajmas]

Given there is a VLC for Android in beta, how about seeing what can be leveraged there for running with Raspberry Pi?

I wonder whether anything learnt on the mobile side, such as optimisations, can be readapted on the desktop side?

The link: http://www.videolan.org/vlc/download-android.html

[daniele_dll]

Hi to all,

after creating the symbolic link for libopenmax, i tried to hack the omxil module but without success: calling bcm_host_init isn't sufficient.

Openmax, on raspberry pi, doesn't return roles for components so it can't find the right component to use for decoding and skip it.

The example hello_video use directly the component OMX.broadcom.video/audio_decode, so i modified the code to skip role searching (in CreateComponentsList omxil.c:135) and to search the component instead of the role.

Now it's capable to load the right component, but it doesn't go ahead because gives the following error "couldn't find an input and output port"

Here the output log

Code: Select all

[0x444004d8] main decoder debug: looking for decoder module: 25 candidates [0x444004d8] omxil decoder debug: fmt in:h264, out: [0x444004d8] omxil decoder debug: component OMX.broadcom.audio_capture [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.audio_capture == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.audio_decode [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.audio_decode == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.audio_encode [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.audio_encode == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.audio_render [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.audio_render == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.audio_mixer [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.audio_mixer == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.audio_splitter [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.audio_splitter == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.audio_processor [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.audio_processor == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.camera [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.camera == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.clock [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.clock == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.coverage [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.coverage == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.egl_render [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.egl_render == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.image_fx [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.image_fx == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.image_decode [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.image_decode == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.image_encode [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.image_encode == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.image_read [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.image_read == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.image_write [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.image_write == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.read_media [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.read_media == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.resize [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.resize == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.source [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.source == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.text_scheduler [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.text_scheduler == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.transition [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.transition == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.video_decode [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.video_decode == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: component OMX.broadcom.video_encode [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.video_encode == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.video_render [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.video_render == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.video_scheduler [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.video_scheduler == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.video_splitter [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.video_splitter == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.visualisation [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.visualisation == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.write_media [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.write_media == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: component OMX.broadcom.write_still [0x444004d8] omxil decoder debug: COMPARISON: OMX.broadcom.write_still == OMX.broadcom.video_decode (25) [0x444004d8] omxil decoder debug: - no roles for the component! [0x444004d8] omxil decoder debug: found 1 matching components for role OMX.broadcom.video_decode [0x444004d8] omxil decoder debug: - OMX.broadcom.video_decode [0x444004d8] omxil decoder debug: loaded component OMX.broadcom.video_decode [0x444004d8] omxil decoder debug: couldn't find an input and output port [0x444004d8] omxil decoder debug: no component could be initialised

I started it using

Code: Select all

LD_LIBRARY_PATH=/opt/vc/lib:/usr/local/lib /usr/local/bin/vlc --verbose 6 --codec omxil wifiguide_fiera.mp4

[Guha]

Is there any success for now?