So you are using a library no longer maintained for years which again uses an intel-specific gcc option (so it is obviously architecture dependent) for fp math and blame that on M1?
Also the terms "Python", "compiled language" and "JVM" doesn't mix for me. No one of this list uses or is any of the other.