I have the same problem.
I have jerky playback on both my MacBook Core Duo and my Mac Pro, both running 10.4.8.
Have been jerky on FLAC and MP3 files since 0.8.5. Have tried 0.9.0-svn also with same problem.
But I have no jerky playback on movie files.