Amazon Echo Gets Open Source Brain Transplant

March 22, 2021 by Tom Nardi 20 Comments

There’s little debate that Amazon’s Alexa ecosystem makes it easy to add voice control to your smart home, but not everyone is thrilled with how it works. The fact that all of your commands are bounced off of Amazon’s servers instead of staying internal to the network is an absolute no-go for the more privacy minded among us, and honestly, it’s hard to blame them. The whole thing is pretty creepy when you think about it.

Which is precisely why [André Hentschel] decided to look into replacing the firmware on his Amazon Echo with an open source alternative. The Linux-powered first generation Echo had been rooted years before thanks to the diagnostic port on the bottom of the device, and there were even a few firmware images floating around out there that he could poke around in. In theory, all he had to do was remove anything that called back to the Amazon servers and replace the proprietary bits with comparable free software libraries and tools.

Of course, it ended up being a little trickier than that. The original Echo is running on a 2.6.x series Linux kernel, which even for a device released in 2014, is painfully outdated. With its similarly archaic version of glibc, newer Linux software would refuse to run. [André] found that building an up-to-date filesystem image for the Echo wasn’t a problem, but getting the niche device’s hardware working on a more modern kernel was another story.

He eventually got the microphone array working, but not the onboard digital signal processor (DSP). Without the DSP, the age of the Echo’s hardware really started to show, and it was clear the seven year old smart speaker would need some help to get the job done.

The solution [André] came up with is not unlike how the device worked originally: the Echo performs wake word detection locally, but then offloads the actual speech processing to a more powerful computer. Except in this case, the other computer is on the same network and not hidden away in Amazon’s cloud. The Porcupine project provides the wake word detection, speech samples are broken down into actionable intents with voice2json, and the responses are delivered by the venerable eSpeak speech synthesizer.

As you can see in the video below the overall experience is pretty similar to stock, complete with fancy LED ring action. In fact, since Porcupine allows for multiple wake words, you could even argue that the usability has been improved. While [André] says adding support for Mycroft would be a logical expansion, his immediate goal is to get everything documented and available on the project’s GitLab repository so others can start experimenting for themselves.

Continue reading “Amazon Echo Gets Open Source Brain Transplant” →

Lightweight OS For Any Platform

March 22, 2021 by Bryan Cockfield 35 Comments

Linux has come a long way from its roots, where users had to compile the kernel and all of the other source code from scratch, often without any internet connection at all to help with documentation. It was the wild west of Linux, and while we can all rely on an easy-to-install Ubuntu distribution if we need it, there are still distributions out there that require some discovery of those old roots. Meet SkiffOS, a lightweight Linux distribution which compiles on almost any hardware but also opens up a whole world of opportunity in containerization.

The operating system is intended to be able to compile itself on any Linux-compatible board (with some input) and yet still be lightweight. It can run on Raspberry Pis, Nvidia Jetsons, and x86 machines to name a few, and focuses on hosting containerized applications independent of the hardware it is installed on. One of the goals of this OS is to separate the hardware support from the applications, while being able to support real-time tasks such as applications in robotics. It also makes upgrading the base OS easy without disrupting the programs running in the containers, and of course has all of the other benefits of containerization as well.

It does seem like containerization is the way of the future, and while it has obviously been put to great use in web hosting and other network applications, it’s interesting to see it expand into a real-time arena. Presumably an approach like this would have many other applications as well since it isn’t hardware-specific, and we’re excited to see the future developments as people adopt this type of operating system for their specific needs.

Thanks to [Christian] for the tip!

A Lockdown Brightened By A Library Of Vintage Usborne Books

March 22, 2021 by Jenny List 33 Comments

Lockdown is boring. No, let’s emphasize that, lockdown is really boring. Walking for exercise is much less fun than it was last year because it’s a wet and muddy February, and with nowhere open, a rare trip out to a McDonalds drive-through becomes a major outing. Stuck inside for the duration we turn our eyes to some of the older ways to wile away the time. Books. Remember them? In doing that I found that the friend whose house I’m living in has the whole library of Usborne children’s computer and technology books from the 1980s. Suddenly a rainy day doesn’t matter, because we’re in a cheerful world of cartoon robots and computer parts!

When Kids Learned Machine Code

A comprehensive selection to get one's teeth into. — A comprehensive selection to get one’s teeth into.

If this leaves you none the wiser, it’s worth explaining that during the 1980s home computer boom there was no Internet handily placed for finding out how your new toy worked. Instead you had to read books and hoard the scraps of information they contained. Publishers responded to this new world of technology with enthusiasm, and the British children’s publisher Usborne did so in their characteristic entertaining and informative style. For probably the only time in history, children were presented with mainstream books telling them how to write machine code and interface directly to microprocessors, and those among them who probably now read Hackaday took to them with glee. They remain something of a cult object among retrocomputing enthusiasts, and fortunately a selection of them are available for download. Usborne are still very much in business producing up-to-date books educating today’s children, and to promote some of their more recent titles for the Raspberry Pi they’ve released them in electronic form. Continue reading “A Lockdown Brightened By A Library Of Vintage Usborne Books” →

MIDI All The Things Hack Chat

March 22, 2021 by Dan Maloney 5 Comments

Join us on Wednesday, March 24 at noon Pacific for the MIDI All the Things Hack Chat with Tim Alex Jacobs!

In our technologically complex world, standards are a double-edged sword. While they clearly make it possible for widgets and doodads to interoperate with each other, they also tend to drift away from their original intention over time, thanks to the march of progress or even market forces. If there’s one thing you can expect about standards, it’s that they beget other standards.

One standard that has stood the test of time, with modification of course, is the Musical Instrument Digital Interface, or MIDI. It’s hard to overstate the impact MIDI has had on the music world since it was first dreamed up in the early 1980s. Started amid a Wild West of competing proprietary synchronization standards, MIDI quickly became the de facto interface for connecting electronic musical instruments together. And as it did, it moved from strictly pro-grade equipment down the market to prosumer and home users, fueled in part by the PC revolution.

Tim Alex Jacobs, who is perhaps better known as Mitxela on his YouTube channel, has long been interested in applying MIDI to unusual corners of the musical world. We’ve seen him MIDI-fy things that barely qualify as musical instruments, and also build a polyphonic synthesizer so small it fits within the shell of the DIN connector that’s so strongly associated with the MIDI standard. Tim joins us on the Hack Chat this week to talk about his experiences with MIDI, and to help us understand all the ways we can work with the interface in our builds.

Our Hack Chats are live community events in the Hackaday.io Hack Chat group messaging. This week we’ll be sitting down on Wednesday, March 24 at 12:00 PM Pacific time. If time zones have you tied up, we have a handy time zone converter.

Click that speech bubble to the right, and you’ll be taken directly to the Hack Chat group on Hackaday.io. You don’t have to wait until Wednesday; join whenever you want and you can see what the community is talking about.
Continue reading “MIDI All The Things Hack Chat” →

sample of automatically generated comics

Read Your Movies As Automatically Generated Comic Books

March 22, 2021 by Michael Shaub 13 Comments

A research paper from Dalian University of Technology in China and City University of Hong Kong (direct PDF link) outlines a system that automatically generates comic books from videos. But how can an algorithm boil down video scenes to appropriately reflect the gravity of the scene in a still image? This impressive feat is accomplished by saving two still images per second, then segments the frames into scenes through analysis of region-of-interest and importance ranking.

For its next trick, speech for each scene is processed by combining subtitle information with the audio track of the video. The audio is analyzed for emotion to determine the appropriate speech bubble type and size of the subtitle text. Frames are even analyzed to establish which person is speaking for proper placement of the bubbles. It can then create layouts of the keyframes, determining panel sizes for each page based on the region-of-interest analysis.

The process is completed by stylizing the keyframes with flat color through quantization, for that classic cel shading look, and then populating the layouts with each frame and word balloon.

The team conducted a study with 40 users, pitting their results against previous techniques which require more human intervention and still besting them in every measure. Like any great superhero, the team still sees room for improvement. In the future, they would like to improve the accuracy of keyframe selection and propose using a neural network to do so.

Thanks to [Qes] for the tip!

How Laser Headlights Work

March 22, 2021 by Lewin Day 142 Comments

When we think about the onward march of automotive technology, headlights aren’t usually the first thing that come to mind. Engines, fuel efficiency, and the switch to electric power are all more front of mind. However, that doesn’t mean there aren’t thousands of engineers around the world working to improve the state of the art in automotive lighting day in, day out.

Sealed beam headlights gave way to more modern designs once regulations loosened up, while bulbs moved from simple halogens to xenon HIDs and, more recently, LEDs. Now, a new technology is on the scene, with lasers!

Continue reading “How Laser Headlights Work” →

Cursed USB-C: When Plug Orientation Matters

March 22, 2021 by Maya Posch 71 Comments

One of the selling points of the USB-C plug is that supposedly there is no way to incorrectly insert it. As [Pim de Groot] shows with a ‘Cursed USB-C 2.0 Device‘, reality is a bit more complicated when it comes to USB 2.0 compatibility in USB-C. He made a PCB that elegantly demonstrates the simplicity of the problem, featuring two LEDs. Only one orientation of the USB-C plug will cause one of the LEDs to light up green, with the other orientation leaving both LEDs blinking red.

Sigil on the back of the cursed USB-C 2.0 device, by Pim de Groot.

The reason for this behavior is simple: as [Pim] explains, although the USB-C plug has only a single pair of data lines (D+/-) for USB 2.0 connectivity, the receptor duplicates these on either side of its pins, leading out two pairs of D+/- lines. Normally you would connect the matching lines in these pairs together to ensure consistent behavior no matter the plug orientation, but you don’t have to.

By leading each USB 2.0 data pair to its own SAMD11C MCU, only one of the MCUs would be connected to USB, resulting in the connected MCU blinking the LEDs. With a bit more circuitry it’s possible to detect which way around the plug is inserted and use this information in a single MCU system, altering its behavior. While at first glance this seems little more than a fun party trick, but it also offers insight in a possible failure mode of USB-C 2.0 devices where only one plug orientation works, due to broken traces or pads.