I was able to get the following things working:
1. Using the manual, streaming a video on demand over rtsp. Pretty straightforward just following the examples.
2. From one of the other entries, streaming a video over http. Basically, it comes down to defining the stream (either vod or broadcast) and making sure that the output option is set first (e.g. setup test4 output #std{access=http,mux=ts,url=0.0.0.0:8080/test4).
The problem is that with option #2 above, specifying the video as VOD or as a broadcast, in both cases one has to do a "control [name] play", which is not necessary in option #1 (the default rtsp delivery of VOD). I was just wondering, is it even possible to do an actual Video on Demand (e.g. set up the stream and have it start up when it's requested, instead of requiring a "play" command) ?