I'm very skeptical about this as well but an argument I saw on here that I found kinda convincing was a comparison to the usual job of a "secretary". Most interactions are verbal and there's a wide variety of tasks that can be solved that way. The real problem is trust in an automated system handling those correctly, which is solvable.

Think, for example, sorting your email inbox by "importance", not based on some flags or fixed heuristics but an actual, intelligent scan of the contents. Think of having reasonable phone conversations that result in scheduling appointments and answering concrete questions.