You mean to tell me...for over three years this has been requested and debated here???
PotPlayer already has this option; just needs to be configured. Go to: Preferences/Playback, then under Navigation/Progress Bar, simply check "Show thumbnail previews"
YES, it can be done.