Automatic Subtitle Generation from Video Audio in VLC

Feature requests for VLC.
Mazufa
New Cone
New Cone
Posts: 4
Joined: 20 Jul 2019 22:07
VLC version: 3.0.20
Operating System: Windows 11
Location: Finland
Contact:

Automatic Subtitle Generation from Video Audio in VLC

Postby Mazufa » 14 Jun 2024 23:09

Hello!

I would like to suggest a new feature for VLC Media Player: automatic subtitle generation from the audio track of videos, with an option to select the subtitle language. It would be incredibly convenient if VLC could automatically create subtitles by transcribing the audio content of the video and allow users to choose the desired subtitle language. This feature would be particularly useful for videos that do not have existing subtitles and for which subtitles cannot be found online. Having VLC generate subtitles from the video's sound would greatly enhance the viewing experience for many users.

Best regards
Mazufa

Rémi Denis-Courmont
Developer
Developer
Posts: 15272
Joined: 07 Jun 2004 16:01
VLC version: master
Operating System: Linux
Contact:

Re: Automatic Subtitle Generation from Video Audio in VLC

Postby Rémi Denis-Courmont » 15 Jun 2024 08:34

That's already implemented with the Whisper plugin. Unlikely that it can ship by default due to the enormous ML model sizes involved.
Rémi Denis-Courmont
https://www.remlab.net/
Private messages soliciting support will be systematically discarded

Mazufa
New Cone
New Cone
Posts: 4
Joined: 20 Jul 2019 22:07
VLC version: 3.0.20
Operating System: Windows 11
Location: Finland
Contact:

Re: Automatic Subtitle Generation from Video Audio in VLC

Postby Mazufa » 16 Jun 2024 13:03

That's already implemented with the Whisper plugin. Unlikely that it can ship by default due to the enormous ML model sizes involved.
So is there a ready-made plugin for VLC Media Player? If so, where can I download it?

Thanks!

Best regards
Mazufa

Rémi Denis-Courmont
Developer
Developer
Posts: 15272
Joined: 07 Jun 2004 16:01
VLC version: master
Operating System: Linux
Contact:

Re: Automatic Subtitle Generation from Video Audio in VLC

Postby Rémi Denis-Courmont » 16 Jun 2024 19:11

Yes, I have seen it in demos. I don't know where and how to install it. Likely needs manual build.
Rémi Denis-Courmont
https://www.remlab.net/
Private messages soliciting support will be systematically discarded

Mazufa
New Cone
New Cone
Posts: 4
Joined: 20 Jul 2019 22:07
VLC version: 3.0.20
Operating System: Windows 11
Location: Finland
Contact:

Re: Automatic Subtitle Generation from Video Audio in VLC

Postby Mazufa » 20 Jun 2024 15:23

Yes, I have seen it in demos. I don't know where and how to install it. Likely needs manual build.
Hello

Would you happen to have a link to this addon? I've tried to look for it but I haven't found the add-on for VLC that you described.

Thanks!

Best regards
Mazufa

Rémi Denis-Courmont
Developer
Developer
Posts: 15272
Joined: 07 Jun 2004 16:01
VLC version: master
Operating System: Linux
Contact:

Re: Automatic Subtitle Generation from Video Audio in VLC

Postby Rémi Denis-Courmont » 20 Jun 2024 21:32

Look for VLC Whisper plugin on code.videolan.org, I suppose.
Rémi Denis-Courmont
https://www.remlab.net/
Private messages soliciting support will be systematically discarded


Return to “VLC media player Feature Requests”

Who is online

Users browsing this forum: No registered users and 25 guests