I think there's a single point that we need to keep an eye out for;

A model that got to the point where it's possible for it to propose new architectures, improve optimization & efficiency.

In other words, the extremely massive model that could do this doesn't need to be available to the public. It's sole purpose should be to be used internally by a company to improve itself.

This is actually the point at which many say could lead to the singularity.