I have a BTT shortcut to maximize window under cursor that was not behaving as expected when maximizing VLC window. Instead of maximizing to the current screen, it crops and maximizes to another screen.
On troubleshooting, I found that it was because VLC was locking the aspect ratio. This issue is resolved by unchecking the two setting in the preferences.
If the screenshot does not load, the settings are under Interface > Main interfaces > macosx:
- Resize interface to the native video size
- Lock Aspect Ratio
Hope that this answer will benefit someone.