>What's the alternative? No voice-recognition? Voice recognition that only runs client-side and lacks all the advantages a centralised service can provide?

Distributed, self-hosting would be far safer than having all of your most personal information owned by a remote centralized authority.