I suspect the theory is that private companies with many clients besides the government are less susceptible to bloat and waste than a government agency is because they are not a singleton entity and will be outcompeted if they are sufficiently inefficient.

A problem with this theory is that, I imagine, a lot of such companies basically only have contracts with the government. So it ends up with the same singleton problems, just outsourced.