I really doubt that the motivation for not publishing the model for "turns text into trippy images" is "it's too powerful to trust the world with it" vs banal business reasons.
The claimed reason for not publishing the model in TFA:
> This leads such models, including Parti, to produce stereotypical representations of, for example, people described as lawyers, flight attendants, homemakers, and so on...
> Models which produce photorealistic outputs, especially of people, pose additional risks and concerns around the creation of deepfakes.
> ...the range of outputs from a model is dependent on the training data, and this may have biases toward Western imagery and further prevent models from exhibiting radically new artistic styles...
> For these reasons, we have decided not to release our Parti models, code, or data for public use without further safeguards in place.
So maybe they're partly afraid that it's too powerful, but even moreso they are afraid it's too white.
