Don’t take this personally, but I don’t think you’ve thought too hard about what you can do with this technology. For instance, you could create audiobooks for every book ever published. You can change scripts for movies after shooting has already happened. Indie game developers can now afford high quality voices in their games. Even AAA games like The Elder Scrolls can vastly expand their in-game voice variety. I think it’s amazing.
You're not wrong, all of that is great. But the capacity for even more spam calls and scammers generating fraudulent content with cloned voice samples will be an immensely annoying issue. Anyone who owns a phone in the modern age absolutely cannot be a Pollyanna when looking at this technology. There are real issues that must be addressed.
Right now if your brother texts you and says they are stuck somewhere and need you to wire them $500, you call them and verify it is legitimate. That is the best answer we have for users.
Once your brothers voice has been cloned and generative AI can deep fake his face on a video call, we are pretty much screwed.
