They are not the only game in town. Lambdalabs will rent you a H100 for $1.99/h. Well, they won't give you 500 at those conditions, they have their own reserved cluster pricing. But between the big cloud providers and specialized GPU providers there's a lot of middle ground available for people who want smaller training runs (though availability is an issue)