As a side note, it always slightly puzzles me when I see "voice interface" and "private" used together. Maybe it takes living alone to issue voice commands and feel some privacy.

(Yes, I do understand that "privacy" here is mostly about not sending it for processing to third parties.)

Private meaning that a big American corporation is not listening and using my voice to either track me or teach their own AI service with it.

> Yes, I do understand that "privacy" here is mostly about not sending it for processing to third parties.

Then why does it puzzle you?

Because you wouldn't ask it deeply private questions in front of your mom, for instance

You wouldn’t ask your partner deeply private questions in front of your mom either. Not sure how you think it’s a dig against voice assistant privacy.

I'm just translating why that person (nine_k) feels that any voice interface is non-private. It's not how I feel

There are levels of privacy. Because I'm not going to ask deeply private questions, it doesn't mean that I want everyone to be snooping into what I'm planning to eat tonight.

I personally agree with your stance, but was simply interpreting what nine_k expressed so everyone else could understand their perspective.

In this scenario, you have intentionally and willfully done something private in public.

> Maybe it takes living alone to issue voice commands and feel some privacy

Perhaps your definition of "private" is more stringent than most people's. Collective privacy exists, for example "The family would appreciate some privacy as they grieve". It is correct to term something "private" when it is shared with your entire household, but no one else.

I don't like these interaces because unless they are button activated or something, they must be always listening and sending sound from where you are to a 3rd party server. No thanks. Of course this could be happening with my phone, but at least it have to be a malicious action to record me 24/7

FWIW that's not even how Alexa or Google Assistant work. Both listen locally for the wake word with onboard processing, and only when they recognize it do they send the audio stream to the server to fully interpret.

You can test this in a couple ways: they'll respond to their wake word when the internet is down (but have an error response). You can also look at the outbound data and see they're not sending continuous traffic.

Not to say with the proprietary products that they couldn't sneakily change this on the fly and record everything, maybe even turning it on for a specific device or account.

The developers could do sneaky things with any device that has wifi and a mic.

And yet most people have a phone in their pocket.

Try to live without it. It's almost impossible. I try to use Librem 5 as a daily driver, with hardware kill switches and GNU/Linux, and it's not always easy.

Well that’s my point, we’ve already just accepted the risk. Probably more than half of people think their phone is spy on them but carry it anyway.

I mean... That's not true, though.

The main pitch of a tool like this is that I can absolutely verify it's not true.

I'm currently running a slightly different take of this (Esp 32 based devices, with whisper through Willow inference server, with Willow autocorrect, tied into home assistant).

For context, it works completely offline. My modem can literally be unplugged and I can control my smart devices just fine, with my voice. Entirely on my local network, with a couple of cheap devices and a ten year old gaming PC as the server.

My data

How these ESP32-systems work is that you send a wake word to the device itself. It can detect the word without an internet connection, the device itself understands it and wakes up. After the device is woken up, it sends your speech to home assistant, which either

  - handles it locally, if you have fast enough computer
  - sends it to home assistant cloud, if you set it up
  - sends it to chatgpt, claude sonnet etc. if you set it up

I'm planning on building a proxmox rack server next year, so I'm probably going to just handle all the discussions locally. The home assistant cloud is quite private too, at least that's what they say (and they're in EU, so I think there might be truth in what they say)...

I'm trying to understand. Is there an SDK I can use to enhance this? Or is this a package product?

I'm really hoping it's the former. But I don't see any information about how to develop with this.

Yep, ESPHome SDK. It's all open source and well-documented:

https://esphome.io/

Some notable blog posts, docs and a video on the wake words and voice assistant usage:

https://community.home-assistant.io/t/on-device-wake-word-on...

https://esphome.io/components/voice_assistant.html

https://www.home-assistant.io/voice_control/create_wake_word...

https://www.youtube.com/watch?v=oSKBWtBJyDE