We are not kinetically bound to the galactic center, there is no friction causing earth to remain "upright" in respect to the galaxy. Earth is also a freely rotating inertial body and, even though wobbly, it is itself a gyroscope.

The next level of stabilization would probably be gravitational waves.