If you’re not worried about corporate surveillance bots scraping your shopping list and manipulating you through marketing, you can buy any number of off-the-shelf smart speakers for your home. Alternatively, you can roll your own like [arpy8] did, and keep your life a little more private.
The build is based around an ESP32 microcontroller. It connects to the ‘net via its inbuilt Wi-Fi connection, and listens out for your voice with an INMP441 omnidirectional microphone module. The audio data is trucked off to a backend server running a Whisper speech-to-text model. The text is then passed to Google’s Gemini 2.5 Flash large language model. The response generated is passed to the Piper Neural Voice text-to-speech engine, sent back to the ESP32, and spat out via the device’s DAC output and a speaker attached to an LM386 amplifier. Basically, anything you could ask Gemini, you can do with this device.
By virtue of using a commercial large language model, it’s not perfectly private by any means. Still, it’s at least a little farther removed than using a smart speaker that’s directly logged in to your Amazon/Google/Hulu/Beanstikk account. Files are on Github for those eager to dive into the code. We’ve seen some other fun builds along these lines before, too. Video after the break.

This: “worried about corporate surveillance bots scraping your shopping list”
Followed by: “Basically, anything you could ask Gemini”
…. does… not… compute
The main problem is not about corporate surveillance, but any IOT on the local network is the potential backdoor for hackers regardless how good is your firewall.
Misleading title. This isn’t “outside the corporate cloud,” since it uses a corporate-cloud-based LLM.
Should be able to use a local LLM, but it would be slower.
Perhaps https://www.home-assistant.io/integrations/ollama
Please stop with the clickbait.