Adding an audio delay causes random sound cuts

[qkviz]

Hi,
I noticed the audio delay function in VLC makes the audio randomly cut later in the playback of DD5.1 and DTS formats in passthrough mode.
Whenever that happens, the sound cuts off for 1 second and then comes back again.
I get those typically 3-5 times per movie and when I rewind to the part in which the audio cut out, it doesn't cut anymore (also with Kodi player it works flawlessly, which is why I'm sure my sources aren't damaged)
When no delay is set for lipsync purposes , I don't get that bug.