The core of Git is incredibly simple and elegant (content addressable database). It's an amazing approach to how to represent the data that needs representing.

The UI is the challenging bit, and that's because Linus just slapped something on to demonstrate it, expecting that a proper UI would be built over the plumbing he'd created.