I haven't tried it, but maybe some larger nose bridge pads with a bit of friction, that would maintain the distance?

Might require you to use a dedicated pair of glasses just with this, if you need some kind of spacing/padding element affixed that you don't need otherwise.