Using the 1.0 nightlies and getting great performance now. No freezes and fast seeking in all formats so far. 1.0 looks very promising: http://nightlies.videolan.org/
I've had this problem when seeking video files. I did have the problem prior to 0.9 but it was very rare, now the problem happens quite a bit. I'm using VLC 0.9.8 on a intel Mac Mini. I believe I may have fixed the problem though, at least for myself. Go to preferences, change to advance Input/Codes...