After switching between keyboards with Esc in different places, I've learned to use

    Ctrl-[

instead. Can hit it without moving that far, and it works just as well in GVim as it does in all terminal programs.

The only downside is being confused when nothing happens in a browser...