You might also check this post - it shows how you can save your preferences so that you don't have to keep adjusting brightness, etc every time you open VLC:
I also have trouble checking the enable box on that menu
One thing I have noticed is that if I am in a maximized screen it does not work...however when it is in the smaller size window it works just fine, change the brightness, THEN I maximize it or go to full screen.