The M14 buses are packed though. It's hard to imagine how you could have a speedy bus line in Manhattan that wouldn't be packed. If it's a good option people will definitely take it.

Another metric to optimize for would be safety. Having the occasional bus driven by a rules-abiding, professional driver is much safer than having constant cars whizzing by.