The idea of basing a business around trying to get people to love a model which could be changed at any time seems both futile and immoral. At least when a person dumps you it's generally understood to be a decision made by a person, not "we adjusted the model for performance reasons and now your virtual partner is essentially dumber and will never be the person you fell in love with." Illness and injury can change a person, but that's a possibility rather than an inevitability for a partner built on top of someone else's model.
This is not a fancy service we are talking about. This is more like reselling nicotine or alcohol on a street corner.
The demand is infinite, because of human psycology. It doesn't really matter if the bots are bad or reliable, users will flood to virtual partners and there will always be a million middlemen ready to connect the dots.
There are ways to mitigate such issues anyway but... Who cares? They really shouldn't be using an OpenAI API for a high quality virtual partner service anyway, but its the absolute easiest and fastest path, and it will flood out high quality implementations.
I guess the availability of effectively limitless AI-based characters that can be designed or tweaked by users will result in a normalized shift away from having "a" girlfriend or boyfriend, and toward maintaining a gamut of virtual relationships, ranging from single-episode encounters to committed long-term romantic chat partners. Once you can cook up any number of chars with any combination of personality, appearance, background, etc. it is unlikely that most users will be interested in a purely monogamous AI relationship. Of course there will be people who "fall in love" with their AI talking doll, but that's a tale as old as Pygmalion.
Love is brain chemistry. Does it matter what’s on the other side of the screen? You’re paying for the feeling, and it always costs something. Informed consent of course.
In a healthy relationship, both partners receive more than they sacrifice in 'costs.' This is the whole point of all mutually entered into relationships...
We can absolutely bet on it mattering, because this screen-mediated shit isn't as good as the real thing, and we know that because substituting social media usage for real socialization triples your chances of depression and anxiety, this is so similar I guarantee it will have a similar negative effect.
The only weird thing is that people are actually buying into this techno-bullshit with a straight face
If love is a piece of the biological puzzle which drives humanity to reproduce, it matters. Regardless of whether we believe global population should grow or shrink in general, our modern society currently runs on the backs of a lot of people. Society will have to change if this level of reproduction is not maintained because it's easier to get an AI partner to tickle your dopamine receptors than it is to raise a family.
I used to think this, but it's not true. While obviously the majority of use, it is not the concerning one. We could already have fantasies, but now they have some small amount of agency. The plot of 'wishes coming to life only to be revealed as curses' is as old as storytelling. The small but important number of people who will become attached beyond what is healthy is a concern, but we will for have to watch it evolve.