Delay in live streaming

[Lightlabyrinth]

After running a live stream over rtsp for a period of time we begin to see a 1-3 second delay. We have started the stream using the parameter :network-caching=400 which helps in the very beginning but like I said it begins to fall behind by 1-3 seconds. Is there a way to force VLC to stay as close to real time as possible?