It is a very useful feature and doesn't have to be dangerous if implemented properly--non-default, with a warning, etc. Foobar2000 has "Delete File" in the context menu and works well--no complaints.
I would like a file to be deleted on the hard drive when I delete it in the playlist. Perhaps with a Shift-Del or a configuration option like "Delete Files Permanently when Deleting from Playlist"?