AI In A Box Envisions AI As A Private, Offline, Hackable Module

October 30, 2023 by Donald Papp 10 Comments

[Useful Sensors] aims to embed a variety of complementary AI tools into a small, private, self-contained module with no internet connection with AI in a Box. It can do live voice recognition and captioning, live translation, and natural language conversational interaction with a local large language model (LLM). Intriguingly, it’s specifically designed with features to make it hack-friendly, such as the ability to act as a voice keyboard by sending live transcribed audio as keystrokes over USB.

Based on the RockChip 3588S SoC, the unit aims to have an integrated speaker, display, and microphone.

Right now it’s wrapping up a pre-order phase, and aims to ship units around the end of January 2024. The project is based around the RockChip 3588S SoC and is open source (GitHub repository), but since it’s still in development, there’s not a whole lot visible in the repository yet. However, a key part of getting good performance is [Useful Sensors]’s own transformers library for the RockChip NPU (neural processing unit).

The ability to perform things like high quality local voice recognition and run locally-hosted LLMs like LLaMa have gotten a massive boost thanks to recent advances in machine learning, and it looks like this project aims to tie them together in a self-contained package.

Perhaps private digital assistants can become more useful when users can have the freedom to modify and integrate them as they see fit. Digital assistants hosted by the big tech companies are often frustrating, and others have observed that this is ultimately because they primarily exist to serve their makers more than they help users.

Continue reading “AI In A Box Envisions AI As A Private, Offline, Hackable Module” →

Mechanical Twitter Feed For Offline Reading

April 18, 2011 by Mike Nathan 11 Comments

Twitter can be a great tool for keeping up to date with your favorite person/company/band/etc. You can find a Twitter client for just about anything that plugs in these days, but sometimes we find that we simply need a break from our computers and smart phones – even if just for a few minutes. What happens when you want to unplug, but still need to know what everyone is up to?

[Patrick Dinnen] asked himself the same thing, and decided that the solution was a mechanical Twitter feed display. The display consists of a static user list strung up against the wall, with a mobile speech bubble mounted next to it. The bubble moves to the user who has most recently updated their status (presumably using a pair of servos), and uses a projector to display their messages. The effect is pretty neat, and it still allows you to get your Twitter fix without staring blankly at your computer screen or smart phone.

We think it would be even cooler if it used a projector on both sides, enabling it to dynamically shuffle through users and status messages at the same time. [Patrick] says that for right now it is merely a proof of concept, so there is no telling how he’ll tweak it going forward.

Continue reading to see his mechanical Twitter feed in action.

[via Adafruit]

Continue reading “Mechanical Twitter Feed For Offline Reading” →