Just talking about memory--far pointers, banks that have to be switched in and out, non-uniform memory accesses, etc.

Putting those into a compiler puts an enormous amount of surface into a compiler that is completely useless on 32-bit architectures.