nVidia VSR video freeze on resize

[Migrax]

Hello,

as nVidia published a new driver yesterday (I use Studio drivers) I wanted to try the latest version of their Video Super Resolution feature with VLC 3.0.20. Earlier driver versions showed VSR as enabled, even though it was not active (in comparison to the 3.0.19 RTX build, the typical GPU load was missing, and there was no visible difference to linear upscaling).

With the new driver, VSR works in principle, and the results are even better than with earlier drivers, but I encountered a stability issue. The steps to reproduce the issue are:

1. Install nVidia 546.01 driver (Studio in my case, but I doubt the Game Ready drivers are different here)
2. Enable VSR in nVidia Control Panel (quality setting does not matter)
3. Enable VSR in VLC 3.0.20: Preferences (all) --> Video --> Output Modules --> Direct3D11 --> Video Upscaling mode: Super Resolution
4. Play a video (the one I use is h.264 1080p60)
5. Resize the window by mouse-drag

The video will freeze almost immediately, and the log shows these errors:

Code: Select all

main debug: resized to 1920x1081 main debug: VoutDisplayEvent 'resize' 1920x1081 main debug: VoutDisplayEvent 'resize' 1920x1081 main debug: resized to 1922x1083 main debug: VoutDisplayEvent 'resize' 1922x1083 main debug: VoutDisplayEvent 'resize' 1922x1083 direct3d11 debug: Detected size change 1922x1081 direct3d11 debug: upscale resolution 1922x1083 direct3d11 debug: turning VSR ON direct3d11 debug: Detected size change 1922x1083 direct3d11 debug: Detected size change 1922x1083 main debug: resized to 1927x1087 main debug: VoutDisplayEvent 'resize' 1927x1087 ... some more debug messages about resizing ... main debug: resized to 1943x1100 main debug: VoutDisplayEvent 'resize' 1943x1100 direct3d11 error: SwapChain Present failed. (hr=0x887A0005) main debug: VoutDisplayEvent 'resize' 1943x1100 direct3d11 debug: Detected size change 1943x1094 direct3d11 error: Failed to create the upscale texture. (hr=0x887A0005) direct3d11 error: Failed to resize the backbuffer. (hr=0x887A0005)

The issue always starts with a single error: SwapChain Present failed. (hr=0x887A0005). The other two errors repeat on further resizing. The video freezes, sometimes the player window freezes completely (though not the messages or the playlist window).

If I just go full screen with a double click (instead of resizing with the mouse), it will upscale using VSR, which looks really good in the latest version. It will play normally, and the GPU load is typical. VSR needs a lot of power, I can easily see it on a watt-meter. I can return to original video resolution with another double click, though it sometimes freezes on that occasion as well.

I reproduced this behaviour on three computers running Windows 10 with different CPUs (Intel Core i7 3770K, Ryzen 7 5800x, Ryzen 9 5950X) and RTX GPUs (RTX 3060, RTX 4070, RTX 4080). I also tried resetting the VLC preferences, which did not make a difference. The nVidia drivers were installed with the reinstall checkbox activated. The issue appears regardless of any monitoring tools running or not running (I used GPU-Z and MSI Afterburner in some test runs, but some were done without any monitoring tool).

I think it is very unlikely that my three test systems have some obscure bug in common that causes this issue, so I would like to know whether anything can be done about this issue from the VLC side, or if it needs some driver fix by nVidia as well. By the way, VSR works with the 3.0.19 RTX build from April and the 546.01 driver, including resizing.

[BravisCharles]

I have the same problem using the Nvidia 546.01 game ready driver and VLC 3.0.20

For me, trying to go full screen using doubleclick also freezes VLC and stops playback.

[kamilskrzypek4]

Hello I have the same issue, video freeze when resizing window when upscaler is set to Super Resolution in DX11.

And yes SwapChain Present failed appearing too

Any fix for that?

VLC 3.0.20
Driver: Game Ready 546.01 - newest one
PC Specs: i7-13700kf / RTX 4080 / 32GB RAM

This is my log output (set to default):

Code: Select all

-- logger module started -- main: Uruchamianie vlc z domyślnym interfejsem. Użyj 'cvlc', aby używać vlc bez interfejsu. main: playlist is empty avcodec: Using D3D11VA (NVIDIA GeForce RTX 4080, vendor 10de(NVIDIA), device 2704, revision a1) for hardware decoding direct3d11 error: SwapChain Present failed. (hr=0x887A0005) direct3d11 error: Failed to create the upscale texture. (hr=0x887A0005) direct3d11 error: Failed to resize the backbuffer. (hr=0x887A0005) direct3d11 error: Failed to resize the backbuffer. (hr=0x887A0005) direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 506x65 texture for OSD direct3d11 error: Failed to resize the backbuffer. (hr=0x887A0005) direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 506x65 texture for OSD direct3d11 error: Failed to resize the backbuffer. (hr=0x887A0005) direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 531x68 texture for OSD direct3d11 error: Failed to resize the backbuffer. (hr=0x887A0005) direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 539x69 texture for OSD direct3d11 error: Failed to resize the backbuffer. (hr=0x887A0005) direct3d11 error: Failed to allocate 581x73 texture for OSD direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 581x73 texture for OSD direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 581x73 texture for OSD direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 581x73 texture for OSD direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 581x73 texture for OSD direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 581x73 texture for OSD direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 581x73 texture for OSD direct3d11 error: CreateTexture2D failed for the 1 pool. (hr=0x887a0005) direct3d11 error: Failed to allocate 581x73 texture for OSD direct3d11 error: SetThumbNailClip failed: 0x800706f4 -- logger module stopped --

[Redline]

Same issue, happens even when the video gets resized by the "resume when you left off?" prompt which results in the video not showing up at all from the start, there's only audio

Code: Select all

-- logger module started -- main: one instance mode ENABLED main: Running vlc with the default interface. Use 'cvlc' to use vlc without interface. avcodec: Using D3D11VA (NVIDIA GeForce RTX 4090, vendor 10de(NVIDIA), device 2684, revision a1) for hardware decoding direct3d11 error: SwapChain Present failed. (hr=0x887A0005) direct3d11 error: fail to create upscaler input direct3d11 error: SwapChain Present failed. (hr=0x887A0005) direct3d11 error: fail to create upscaler input direct3d11 error: SwapChain Present failed. (hr=0x887A0005) direct3d11 error: fail to create upscaler input direct3d11 error: SwapChain Present failed. (hr=0x887A0005) direct3d11 error: fail to create upscaler input direct3d11 error: SwapChain Present failed. (hr=0x887A0005)

And it repeats that forever, gets stuck running in the background when trying to close it and I have to kill the process in task manager

[robUx4]

I can reproduce the issue on a RTX 3070 and 546 Studio drivers. Going fullscreen (double click on the video) it works fine. But resizing manually gives this issue:

Code: Select all

NVWGF2UM: Failed to run Algo 2 of Stream 1. D3D11: Removing Device. direct3d11 vout display error: SwapChain Present failed. (hr=0x887A0005)

It might be an internal bug in the drivers.

[robUx4]

53x Drivers work, 54x Drivers don't work. Maybe we're doing something wrong, but it seems the drivers are behaving differently now. And since it fails in the driver there's no way for us to tell...

[kanttouchthis]

I have the same issue (RTX 3090), tried 3.0.19, 3.0.20 and nightly and they all had the same issue, but only with some videos.
I was trying to play an 853x480 video.
I rescaled it with ffmpeg:

Code: Select all

ffmpeg -i in.mp4 -vf "scale=-1:-1" -aspect 16:9 out.mp4

Which produced a video that was 854x480 (16/9).
It worked fine afterwards. I presume the issue is an issue with an odd width/height. The debug log does say

Code: Select all

main debug: requested window size: 1279x720

and i guess that is likely the culprit. Some videos that have even w/h might also get rescaled and end up with an odd w/h due to rounding, causing VSR to break

[GrinGi]

I had the same issue on 3.0.19 and 3.0.20.
i9-13980HX + RTX 4080 (laptop)
And I found a solution that works, at least for me.
I found out that there is no problems with resizing on 3.0.19 portable downloaded from here:
https://downloads.videolan.org/testing/ ... -upscaler/
while the issue is still relevant for installed 3.0.19.
Also I discovered that the freezing is probably caused by \plugins\video_output\libdirect3d11_plugin.dll
So, I just replaced this dll in the installed VLC with libdirect3d11_plugin.dll from the portable version.
Have no idea about technical details, but such workaround resolves the issue, everything works stable and properly.

[Theliel]

I had the same issue on 3.0.19 and 3.0.20.
i9-13980HX + RTX 4080 (laptop)
And I found a solution that works, at least for me.
I found out that there is no problems with resizing on 3.0.19 portable downloaded from here:
https://downloads.videolan.org/testing/ ... -upscaler/
while the issue is still relevant for installed 3.0.19.
Also I discovered that the freezing is probably caused by \plugins\video_output\libdirect3d11_plugin.dll
So, I just replaced this dll in the installed VLC with libdirect3d11_plugin.dll from the portable version.
Have no idea about technical details, but such workaround resolves the issue, everything works stable and properly.

Yes, you are right, with 3.0.19 lib, 3.0.20 work pretty well in my side too. Even on nightly it didn't work well for me, working fine now, thank for the tip.

[YoLolo69]

I had the same issue on 3.0.19 and 3.0.20.
i9-13980HX + RTX 4080 (laptop)
And I found a solution that works, at least for me.
I found out that there is no problems with resizing on 3.0.19 portable downloaded from here:
https://downloads.videolan.org/testing/ ... -upscaler/
while the issue is still relevant for installed 3.0.19.
Also I discovered that the freezing is probably caused by \plugins\video_output\libdirect3d11_plugin.dll
So, I just replaced this dll in the installed VLC with libdirect3d11_plugin.dll from the portable version.
Have no idea about technical details, but such workaround resolves the issue, everything works stable and properly.

I had the exact same issue and it was fixed following your instructions (copying libdirect3d11_plugin.dll). Thanks for your post!

[kamilskrzypek4]

I had the same issue on 3.0.19 and 3.0.20.
i9-13980HX + RTX 4080 (laptop)
And I found a solution that works, at least for me.
I found out that there is no problems with resizing on 3.0.19 portable downloaded from here:
https://downloads.videolan.org/testing/ ... -upscaler/
while the issue is still relevant for installed 3.0.19.
Also I discovered that the freezing is probably caused by \plugins\video_output\libdirect3d11_plugin.dll
So, I just replaced this dll in the installed VLC with libdirect3d11_plugin.dll from the portable version.
Have no idea about technical details, but such workaround resolves the issue, everything works stable and properly.

It's still not working properly after fix, the video ratio is dissorted when on full screen

[GrinGi]

It's still not working properly after fix, the video ratio is dissorted when on full screen

This is true, but this bug can be fixed only from developers side, as far as I can see. But anyway, choosing the proper video ratio by hands could be a temporary solution. At least for more or less standard ratios

[StevenWings]

I have the same issue. Any ideas when we can expect an update/fix?

As a temporary solution, depending on the video file format, you can try and play it via Microsoft Edge - mp4 seems to work perfectly fine but more complex formats don't.

[hudeman]

I was having this same issue, but for me it was fixed by switching to the win32 version of VLC from win64.

[Migrax]

I just tested the new release 3.0.21, and for me the issue is fixed. I can play a video in VLC 64bit with nVidia Super Resolution enabled and then enlarge it by dragging a corner, and the video won't freeze any more. Tested on three different nVidia GPUs.

Thanks to the VideoLAN team!

[kamilskrzypek4]

I just tested the new release 3.0.21, and for me the issue is fixed. I can play a video in VLC 64bit with nVidia Super Resolution enabled and then enlarge it by dragging a corner, and the video won't freeze any more. Tested on three different nVidia GPUs.

Thanks to the VideoLAN team!

Yeah, it's not working, when Super Resolution is enabled the video is not enhanced and in the control panel says it's incative

[Migrax]

Have you enabled it both in VLC (Settings --> Video --> Output modules --> Direct3D11 --> Video Upscaling Mode) and in nVidia Control Panel under "Adjust video image settings"? Super resolution has to be enabled in both.

It may also depend on the nVidia driver version. I had some driver versions that did not enable Super Resolution with the VLC 3.0.19 beta. My current driver is 555.99 Studio.

If I start playing a video without upscaling it, Super Resolution is not active. As soon as I increase the video size (e. g. by dragging a corner of the VLC window), Super Resolution is activated. I can see the effect, especially on the edges of static parts like network logos. It is also shown as active in nVidia Control Panel, and MSI Afterburner shows the video card clocking higher and getting warm. Even a watt meter shows the increased power. Be aware that Super Resolution requires a lot of power. Depending on the video and the quality setting, it can draw up to 150 W on an RTX 4070 Super (that was a 1080p60 video upscaled to 2160p on maximum quality).

[kamilskrzypek4]

Have you enabled it both in VLC (Settings --> Video --> Output modules --> Direct3D11 --> Video Upscaling Mode) and in nVidia Control Panel under "Adjust video image settings"? Super resolution has to be enabled in both.

It may also depend on the nVidia driver version. I had some driver versions that did not enable Super Resolution with the VLC 3.0.19 beta. My current driver is 555.99 Studio.

If I start playing a video without upscaling it, Super Resolution is not active. As soon as I increase the video size (e. g. by dragging a corner of the VLC window), Super Resolution is activated. I can see the effect, especially on the edges of static parts like network logos. It is also shown as active in nVidia Control Panel, and MSI Afterburner shows the video card clocking higher and getting warm. Even a watt meter shows the increased power. Be aware that Super Resolution requires a lot of power. Depending on the video and the quality setting, it can draw up to 150 W on an RTX 4070 Super (that was a 1080p60 video upscaled to 2160p on maximum quality).

Yes, in VLC changed output module to DX11, upscaling mode changed to super resolution. In Nvidia CP Super Resolution is enabled but inactive when palying video in VLC (in chrome it says active and I can see more power consumed by GPU). Drivers are 556.12 Game Ready

[Theliel]

3.0.21 work better, but only with horizontal videos, on vertical videos something dont work fine, the scale its completely broken