Page 1 of 1

Wacthing and listening to 360 video with Ambisonics

Posted: 06 Feb 2018 19:32
by jtibau
Hi,

VLC 3.0-git seems to have some initial implementation of 360 video and it also seems like ambisonics is on the cards for the near future.

I assume that when the implementation is finished we'll have VLC do some HRTF transform and rotate the audio as well as the video. Currently however, it seems to be ignoring the 2 out of the 4 ambisonics b-format channels. I don't know if there's an attempt at rotation yet.

Can anyone help me figure out if there's some easy way to force it to pass through the 4 channels in the video? I'm currently using MacOS and soundflower to, hopefully, get the B-format to MAX MSP and then run the HRTF transform. That still leaves open the question of the rotation/panning to make sure that the audio is pointing to the same place that the video is.

Javier

Re: Wacthing and listening to 360 video with Ambisonics

Posted: 10 Feb 2018 14:47
by jtibau
Now that 3.0 has been released I'm happy to say that VLC passes through the 4 ambisonics channels. I don't think however, that it is doing the point-of-view rotation of the audio escape. I'm afraid that by "original", what shows up in the menu, it really means unadultered audio feed. Which is interesting but leaves us with spatially-unsynchronized AV.

Any tips?

Re: Wacthing and listening to 360 video with Ambisonics

Posted: 17 Jun 2018 23:02
by Jean-Baptiste Kempf
Now that 3.0 has been released I'm happy to say that VLC passes through the 4 ambisonics channels. I don't think however, that it is doing the point-of-view rotation of the audio escape. I'm afraid that by "original", what shows up in the menu, it really means unadultered audio feed. Which is interesting but leaves us with spatially-unsynchronized AV.

Any tips?

It does, if the file is correctly tagged.

Re: Wacthing and listening to 360 video with Ambisonics

Posted: 06 Nov 2020 12:03
by bossesand
I have created an open HW + source code  for a headtracker that broadcasts OSC messages over a local wifi network.
https://github.com/bossesand/OHTI-HT-osc-wifi

Is there a plugin or interface in VLC 3 that can support a headtracker for viewpoint change on a stationary computers running windows or OSX?
Can a vst for like IEM SpaceRotator ambisonics rotation be included in the playback chain?
Or is there any known way to control the viewpoint from an external sensor instead of the local sensor on Android or swipes/mouse movements.

I cannot find any documentation on headtracker use.


I cannot not find anything in VLC Forum
Best RegardsBo-Erik Sandholm
Stockholm

Re: Wacthing and listening to 360 video with Ambisonics

Posted: 01 Aug 2021 23:05
by neosettler
Is there any update on viewpoint changes and/or 3D specialization audio channels?