I solved this by reinstalling VLC and resetting the settings. When you start it the first time it asks you if you want to allow metadata stuff from the internet, just uncheck that and save. It didn't download some crappy youtube thumbnail as the cover art for my mp3 the next time I used it.