Don't really know what I messed up but not even stable versions like 2.1.4 or 2.1.5 seem to do it for me. Any file played on VLC will make it crash.
Since crash report is too long to be posted, here's the pastebin link:
http://pastebin.com/RkZU8RpX
Edit.
Just figured out it was because I switched from default hardware acceleration to "Vide Decode Framework Acceleration". Does that mean that my nVIDIA 320M (2010 MacBook Air) does not qualify for hardware decoding?