Wow I didn't even think of this, that people could use this for something so horrifying. I'm relived that the geniuses behind this seem so smart that they even thought of this too and prohibit using the AI for sexual images.
> Our content policy does not allow users to generate violent, adult, or political content, among other categories. We won’t generate images if our filters identify text prompts and image uploads that may violate our policies. We also have automated and human monitoring systems to guard against misuse.
This is arguably the most insipid and stupid crippling of a powerful tool for content creation I can think of. It’s worse than the adobe updates using every cpu core and locking up my machine once a week.
What counts as “political” hm? Want it to look like that Obama poster or perhaps you want a Soviet Union flag for your retro 80s punk… oops sorry “political”… let’s go to adult… hmm that’s even dumber is the model showing too much ankle? What about the obvious fact that this is just designed with a heterodoxy view of pornography and likely does nothing to stem the wildly various fetishes and other sexual proclivities that exist in the world…
It is effectively “we got squeamish and have done a bunch of stuff to stop you doing stuff that makes us squeamish, please don’t make us squeamish, we’re so worried we’re even checking for it in case you sneak something past us”…
They should comply with the law, try to prevent and also check for child porn… but otherwise just let users use the damn tool, if someone wants an Obama hope poster of a sexualised Mussolini jerking off onto a balloon animal… why the heck do they feel the need to say no to that. It’s a deeply repressive instinct that should be fought against whenever people start to “police” what is acceptable in artistic mediums.
I look forward to the reimplemented versions of this from efforts like EuletherAI and others.
> Our content policy does not allow users to generate violent, adult, or political content, among other categories. We won’t generate images if our filters identify text prompts and image uploads that may violate our policies. We also have automated and human monitoring systems to guard against misuse.