In vimium you can press 'i' to go into 'insert mode (sort of)' which works similarly (albeit not as well as) vimperator's passthrough mode.

Adding the exclusion is probably the best route though.