This is shared infrastructure. If it costs you $16,000 to build out to a neighborhood of 10 people, then you have to set the price at a point where you can amortize that cost over the maximum number of subscribers. The Netflix junkie may be willing to pay $130/month, but if he's the only one that signs up, your cost per subscriber explodes. Thus, if you're a provider, the amount of money you are willing to spend on telecom infrastructure is going to be dictated by how much that, say, 60th percentile customer is willing to pay, not how much the 90th percentile customer is willing to pay.
Now, you can ameliorate this somewhat based on per-GB charges, but people have an irrational hatred of that. The business deals on the backend are obscure, but at the end of the day, how much a customer spends on services on top of their internet connection is a decent proxy for how much utility they derive from that connection.
Why not just price it as $/month for X transfer, with $/GB above that rate? That'd be simple, transparent, no damage to the market structure of internet businesses, no future anti-trust cases, and we're straight-up paying for the infrastructure that we, as consumers, are using.
Is your case that more money would go to network improvements with the backroom deal routine? Have you considered that the backroom deal routine allows a lot more room for pocketing money and not really investing in the network?
Now, you can ameliorate this somewhat based on per-GB charges, but people have an irrational hatred of that. The business deals on the backend are obscure, but at the end of the day, how much a customer spends on services on top of their internet connection is a decent proxy for how much utility they derive from that connection.