Buffer instead of skipping when streaming?

[Frejoh466]

So when I watch streams like Twitch, I get a white screen and VLC skip a few moments of the stream. I assume there isn't an big enough buffer, so it skip the part it hasn't downloaded. While I could set a ridiculous buffer so Twitch has time to send it, I rather like to avoid having unnecessary delays because it is live.

So can I make VLC to wait for that part to download, and then continue with the delay it took to download that part?

Ex. I'm watching a stream with 0ms delay, VLC don't have next part and freeze the screen for 500ms to download the part, now I'm watching stream with 500ms delay with a bigger buffer. If it doesn't have next part it freeze for 100ms to download the next part and play it again now with an 600ms delay, etc.