I'm more worried that humans will use these things to pollute the entire digital world with realistic garbage until the digital world can never be trusted to convey reality again.
Imagine talking to a friend for 30 min on chat and then realizing it's a bot trained on your friend's hacked phone.
Oh that's nothing new. My Dad was a landlord and called up a tenant about a reported problem.
They talked for 20 minutes before either one realized, wrong number. This renter also had that problem with their landlord and was pleasantly surprised to be contacted about it so promptly. But it was the wrong landlord.
I get it; in future folks will use this for fishing and whatnot. But humans do that already!
Imagine talking to a friend for 30 min on chat and then realizing it's a bot trained on your friend's hacked phone.