I have the same problem when I have GOM player open. When I close it and then also close VLC, and then restart VLC, everything's fine.
It seems to me that some applications share some audio module which causes VLC audio to stutter when they're both open.