I've tried the JAVA_HOME definition as quoted, unquoted, and the old DOS format as above. No joy.
The VLC log puts out:
libbluray error: BD-J menus not supported. Playing without menus. BD-J support: 1, JVM found: 0, JVM usable: 0
So, the problem is in the bluray library.