If you want you can download the zip file. It doesn't have an installer nor does it create links for extensions. But VLC works normally when you call files into the the program for processing. Links however must be created manually.
Alternately you can move VLC and edit your registry for the path of every VLC.EXE entry.