Hi, I'm the author of this post. I hope you all enjoy it! I researched and wrote this back in January, and although the main ideas are still relevant, the landscape of AI art generation has changed quite a bit in just three months. Here are some important new developments:
Glad you did this. I started working on something myself in January as I was dabbling in it but the whole scene was evolving so fast I was like, by the time I write it the piece will seem like a time capsule. The survey/history style is good and educational, maybe this will spur me to put out the effort and do my own..
In case one day you'll want to increase its use, I suggest to put it at least in the homepage source (where we go check if we find there a literal 'rss', or 'feed', or maybe 'xml').
If you want an up-to-date list of open implementations, it's here https://pharmapsychotic.com/tools.html Whatever is the newest Disco Diffusion has been the best around for the past few iterations.
For the first and third, I can't, it isn't my code.
For the second, I have to get approval from my employer to release it, but I stalled out half way through the paperwork and haven't had the energy to keep pushing it forward.
It’s cool to see the impact colab has had here too. It seems like a huge enabler in the art community of people who would otherwise have tons of overhead to play around (getting and setting up the machine and libraries). It’s awesome that google just gives away this scarce resource (gpu cycles) for free.
I still love the deep dream style tho :) Feels the most like the AI is coming up with it's own art by itself for other AIs which I find just the right amount of unsettling
Can't wait to try out the colab links later today! Thanks so much for the great article :)
A couple years ago I decided to fork StyleGAN, optimistic to kick the tires and just see if it would run on my desktop. I got bored after an hour or two and scrapped the setup, having felt it was too complex for someone with a casual interest.
Fast-forward to finding the link to NightCafe a half hour ago, where I just had to type a ridiculous phrase for it to spit out something that attempted to match my description after just a few minutes: https://creator.nightcafe.studio/creation/sPsmFbpijhePoRDwqF...
Still, I don't see using this for anything more than gags with friends right now. But it's a solid leap forward.
There's certainly a market for AI generated art. But, of all of the AI art that I've looked at, it all lacked "soul". It feels like writing I've read that was generated by GPT-3 - it has a very pleasant way of saying a lot of nothing.
My professional artist friend said the same thing. I don't think anyone could define the term if they wanted to. I see enormous beauty and great "imagination" in what DALLE-2 is producing, e.g.:
For myself, I feel fairly confident that if I were shown a work and had to determine whether it was made by a human or by AI, that I could not reliably do so.
The linked post suggests that AI art started in 2015 (what it labels as "early forms of AI art"). AI art goes back decades--it didn't start with Google. Perhaps the author might want to look a bit further back than seven years.
A year ago or so there was a video posted about an AI generated video. It was extremely scary. Almost like a emotionless psychopat with absolutely zero feelings towards humans. Anyone remembers where to find it?
> ...the main development is the rise of *multimodal learning*.
> Multimodal learning, in this case, is learning to match up text and images. Our new models are really good at learning to write captions for images, and (more importantly for artistic purposes) to generate images that correspond to a given caption.
Can anyone explain this more? I think I recall Facebook was automatically generating captions for images automatically a good while ago, but this is something different?
I'll add another - https://twitter.com/PasanenJenni does some fantastic work by combining AI generation with more traditional digital art; great stuff.
Am i alone in thinking that the older ai art looks artistic, where the newer art just looks like superficial images, which while potentially technically impressive aren't really interesting artisticly interesting.
...and we will be empowered of a power almost unimaginable.
--
¹Well, I just had to be more explicit for a post nearby, so I'll copy that: «[...] an artistic object is a concretion of a structure of meanings. It takes a proper intelligence to build that - you need conceptual depth, reflection etc.: you have by definition wait for a GAN»
Probably the creativity is in the eye of the beholder in that case. Anyway there are billions of people that even don't think about art or not art. They look for pretty pictures to put in a frame and the only thing that matters to them is the price of the picture plus the frame. Best if it costs less than a meal. The painter or the photographer could be unknown or an AI, they couldn't be bothered. My point is that it opens a market for very low cost unique self made pictures and if it happens people won't care if it's art. Pretty would be enough.
You missed the important point: an artistic object is a concretion of a structure of meanings. It takes a proper intelligence to build that - you need conceptual depth, reflection etc.: you have by definition wait for a GAN.
To elicit emotions (per se not quite a demanding endeavor) is not sufficient to be qualified as "art".
> an artistic object is a concretion of a structure of meanings
This is a very narrow definition that discounts a lot of art. I'm also very dubious that proper intelligence [1] is required to build that (GPT3's output could certainly be accurately described that way).
[1] I agree that there is no intelligence at work in these algorithms.
Any significant sentence GPT-3 spits out will have more meaning, structure of meanings, and concretion of structure of meanings than most of the images on those pages. Those images all show up when searching for "art", even though your narrow definition discounts most of them as such, which means your definition is faulty. I don't think you can claim all those thousands/millions of people are wrong about what constitutes "art". I also don't think you can sensibly proclaim a faulty definition of something as general (and text-inclusive) as "an artistic object" to be "the important point" and then get annoyed when someone points out problems with it.
Maybe you're thinking of replying claiming all the images I linked above have meaning in them, but that could only be the case if you used a definition of "meaning" so broad as to be meaningless (e.g. "a person selecting it provides meaning", which to me translates to "it elicits emotion" since that's why it was chosen, and you already argued against that). Yes, an art critic might claim to find meaning in totally abstract artwork, but they'd find more meaning in most artistic images generated with machine learning, especially if you don't tell them the source.
> Any significant sentence GPT-3 spits out will have more meaning, structure of meanings, and concretion of structure of meanings
In the naturally intelligent reader or in the machine?
> narrow definition
/Ostensive/ definition. "Narrowing" because it is a (piece of a) definition. (It excludes shallowness.)
> your definition is faulty
If the reading (interpretation) is.
> I don't think you can claim all those thousands/millions of people are wrong
Well...
> when someone points out problems with it
Apart from that "something in the air" of historic duration and consequences, but curiously unusually present here in the latest few days, of heightened communicational struggles, yesterday I thought of other recent exchanges here showing that approach: «Is this place still attended to by people who build things, or is this the turn of consultants who think their job is to shake their heads and present an invoice?». Also with reference with those - present in this club - that use e.g. logic or science to "close paths" instead of furthering them.
> Maybe you're thinking of replying claiming all the images I linked above have meaning in them
No. I am still thinking of replying that either the creator intended to represent a found structure of proper meanings - concepts refined in a path towards maturity - or the product is phony.
If I could kindly ask you to take a brief look to my reply to krapp yesterday: surely a critic may find meaning in a random composition - a critic-in-act would because "we" do, we recognize those structures of meaning we were "internally" developing into all that could represent them (aaand look, that's the Arts - normally, when we reproduce that intentionally) - but then, the art is in the subject, not in the object.
So: before you can have an "artist" AI, you have to have a "philosopher" AI. (Sophistication matters little; "modules" do.) Otherwise, you may have a "mockerer" AI, a "trickster", a "deceiver", if there is no substance, no depth under the surface.
>You missed the important point: an artistic object is a concretion of a structure of meanings. It takes a proper intelligence to build that - you need conceptual depth, reflection etc.: you have by definition wait for a GAN.
I didn't miss the point, i'm arguing the point is debatable. There are entire artistic movements whose thesis is to deny the necessity of "meaning" in art, apart perhaps from whatever meaning the viewer imparts to it. If you didn't know some of these works were done by an AI, you would see the 'conceptual depth, reflection, etc.' in them, but that emotional, empathetic connection one has with a work of art is entirely fabricated. These AIs respond to natural language requests in ways that can be indistinguishable from human effort, they pass the Turing Test for creativity without intelligence.
So I think it's valid to question whether art necessarily requires any such thing on the part of the "artist" at all, or if we just believe it does because we're afraid that if creativity can be generated by an algorithm, it's just another sign that we're nothing more than deterministic machines ourselves.
> There are entire artistic movements whose thesis is to deny the necessity of "meaning" in art
If such thesis founds the artistic production, then this will be the «concretion of a structure of meanings» around the «den[ial of] the necessity of "meaning" in art».
There's "a whole world" of bodies of knowledge and "persons" (individual expressions of the possible forms of being in a supposedly organic - consequential - relation to the richness of being) founding an artistic expression. Have a creature experience being and react to it in proper senses, then the expression may start being artistic.
> These AIs respond to natural language requests in ways that can be indistinguishable from human effort, they pass the Turing Test for creativity without intelligence
So the artist - provided that the quality is actually there - in that case is the reader. That is already part of art ("If I put in my books everything people read in them I'd be a genius", someone said - I cannot recall who). It does not mean that the original product is artistic, that "it has what it takes".
Also: Turing Tests are far from objective, with reference to length or time (etc.) measurements. They surely may pass in front of some Turing Test/ers/. Surely some students pass, after some professors. It is even recorded that some professors managed to have a career and be illiterate.
> or if we just believe it does because
Even if the creator were a «deterministic machine», there would be a complexity in play and the presence or absence of modules to make the difference.
Without them, easily the system will show to be brittle - take for example the visual classifiers that were at some point shown to "recognize" textures but not shapes, that will change response upon the change of an actually irrelevant pixel etc.
> to question whether ... or
There is no question in that false dichotomy: proper human creation has grounds through modules that current AI does not have. All modules must be in place.
Anything can "create" - "unintentionally", "unawarily" etc.: with limited depth.
It is called in this specific sense of the term 'intelligent' the entity which writes the implementation of a function from some input to some intended output; the engineer which creates a writer of functions from some input to some intended output is said to have created an "intelligence".
If somebody wears a thicker coat during a "cold war", the problem is not considered terminological.
- DALL-E 2: https://openai.com/dall-e-2/
- Midjourney: https://twitter.com/midjourney
- Laion 5B dataset: https://laion.ai/laion-5b-a-new-era-of-open-large-scale-mult...
- Compvis latent diffusion: https://github.com/CompVis/latent-diffusion
Since the field is moving so quickly, this newsletter is a good way to try to stay on top of things: https://multimodal.art/news
Also I went on Yannic Kilcher's podcast to talk about this! https://www.youtube.com/watch?v=DdkenV-ZdJU&ab_channel=Yanni...