Exactly, put bots into the world with cameras and you have infinite training. Humans also need a ton of data to train on and have way more parameters than the biggest ML model today

You can also gather arbitrarily more video data by just turning on some webcams and pointing them at the world.

In addition you can also feed your system from video games.

Microphones, too.

Yes. When I wrote video, I meant audio and visual.