Every person I know who has talked about public transport says the other people (especially bums napping and skeevy people) are the big thing that limits the amount of traveling they do on rails and buses. Reach and timing take up the next two slots.
I can definitely feel 'trapped' when people invade my personal space, especially if they smell or have a cough. Those experiences are horrible for the extended amounts of time required for a commute. I still ride, but driving really isn't an option.
Sometimes I wonder why public transport doesn't raise the prices during rush hour to create an equilibrium where the trains don't become sardine cans. I guess economically and somewhat ethically it might be harmful.
I pay $10 to get to work and back in rush hour. Parking is $12 for the day, plus gas and wear and tear. I would gladly pay some extra cash if it made the trains emptier, cleaner, and more reliable.
I find dislike of public transit strange. I have a strong dislike of cars - you have to pay for the car, you have to pay for insurance, you have to pay to fix it when it randomly breaks, you have to pay for gas, it lives outside your house on the street (so who knows what could happen to it late at night)... I could go on.
My ideal transportation arrangement is a subway pass in my wallet and nothing else.
Which, in the USA, pretty much limits you to New York, Chicago, and Boston, it seems. Not that those wouldn't be my ideal places to live anyways, but it's still frustrating.
Public transit-only travel is workable in Philadelphia and Washington, D.C. as well. Although in Philadelphia, you would have to take the buses quite often to compensate for the gaps in the subway system.
Personally I avoid it because it's not very reliable(in Houston at least. It was pretty reliable in Germany) and it's not that effective at getting me where I want to go. There's still huge sprawls of land that are actively used but not connected to the public transport routes.