My favorite books on computer architecture:

_Modern Processor Design_ (Shen and Lepasti). Lots of material on superscalar processors, with some nice examples from existing work.

_The Pentium Chronicles_ (Robert Colwell). Much less technical, but a lot about the social nature of getting a significant CPU design done.