They do mind, which is why we see such a huge drop off in retention if pages load even seconds too low. They just don't describe it in the same way.

They don't say they buy the iPhone because it has the fastest CPU and most responsive OS, they just say it "just works".