I've also observed this general expectation, but what do you mean "cause violence"? Do you mean it's less likely for the cab driver to get mugged if a guy rides in front or something similar?
Eh, it's not just mugged, although I suppose that's part of it. More just punching/stabbing attempts, they're either high, drunk, or mad about the fare etc.