Strange, I find it to be significantly faster & lighter than most other webapps I interact with daily. I think historically they've had a huge culture of using as little Javascript as possible, which I really appreciate.
Other web apps probably aren't any better. It's just that other than some Wiki stuff, where network interactions aren't in the fast path, GitHub is the only web UI I'm forced to use with any frequency.