What I ended up doing (but it is an ugly workaround),
- Stream my microphone from vlc on say :8080/mic.mp3
- Open the url in chrome and cast it from there
This however generates a slight delay (~6 seconds for me) which is I guess due to buffering and other latency aspects of the streaming server.