I just found out, that in at-least VLC 2.2.2 on Windows, if your mouse is over the time selector bar and you use middle scroll that it will step the video forward and backwards. It's not per frame but considering it's an easy way to step backwards it works for me.