audio processing

4 Articles

Flute Now Included On List Of Human Interface Devices

April 24, 2024 by 17 Comments

For decades now, we’ve been able to quickly and reliably interface musical instruments to computers. These tools have generally made making and recording music much easier, but they’ve also opened up a number of other out-of-the-box ideas we might not otherwise see or even think about. For example, [Joren] recently built a human interface device that lets him control a computer’s cursor using a flute instead of the traditional mouse.

Rather than using a MIDI interface, [Joren] is using an RP2040 chip to listen to the flute, process the audio, and interpret that audio before finally sending relevant commands to control the computer’s mouse pointer. The chip is capable of acting as a mouse on its own, but it did have a problem performing floating point calculations to the audio. This was solved by converting these calculations into much faster fixed point calculations instead. With a processing improvement of around five orders of magnitude, this change allows the small microcontroller to perform all of the audio processing.

[Joren] also built a Chrome browser extension that lets a flute player move a virtual cursor of sorts (not the computer’s actual cursor) from within the browser, allowing those without physical hardware to try out their flute-to-mouse skills. If you prefer your human interface device to be larger, louder, and more trombone-shaped we also have a trombone-based HID for those who play the game Trombone Champ.

Steamboat Willie Never Sounded Better

January 24, 2024 by 13 Comments

Mickey Mouse’s introduction to the world was the 1928 cartoon, Steamboat Willie. Not only was it the first appearance of Mickey with sound, it was also one of the first cartoons to employ synchronized sound. The problem is, the sound is awful. Sure, after nearly a century, what do you expect? But [Oona Räisänen] thought it wasn’t just age, but flutter from the original recording. Could it be made better? What follows that question is a self-described geek’s journey into the depths of recorded sound.

The first step was to find a high quality source. The Internet Archive had a copy that was mostly clean. But it also has a lossless scan of the movie including the original optical soundtrack. A quick script played back the original soundtrack and — you guessed it — the flutter is already there. You can see the original 7-minute short from Disney’s channel, below.

Continue reading “Steamboat Willie Never Sounded Better” →

Pause Your Tunes When It Is Time To Listen Up!

September 2, 2020 by 9 Comments

“Sorry. I had music playing. Would you say that again?” If we had a money-unit every time someone tried talking to us while we were wearing headphones, we could afford a super-nice pair. For an Embedded C class, [extremerockets] built Listen Up!, a cutoff switch that pauses your music when someone wants your attention.

The idea was born while sheltering in place with his daughter, who likes loud music, but he does not want to holler to get her attention. Rather than deny her some auditory privacy, Listen Up! samples the ambient noise level, listens for a sustained rise in amplitude, like speech, and sends a pause signal to the phone. Someday, there may be an option to route the microphone’s audio into the headphones, but for now there is a text-to-speech module for verbalizing character strings. It might be a bit jarring to hear a call to dinner in the middle of a guitar riff, but we don’t like missing dinner either, so we’re with [extremerockets] on this one.

We don’t really need lots of money to get fun headphones, and we are not afraid of making our own.

The HackadayPrize2020 is Sponsored by:
Supplyframe
Digi-Key
Microchip
Arm

Tutorial On Signal Processing In Linux With Octave

June 30, 2016 by 12 Comments

If you’ve taken any digital signal processing classes at a college or university, you’ve probably been exposed to MATLAB. However, if you want to do your own work, you might think about Linux and one of the many scientific computing applications available for it.

[David Duarte] recently published a three-part tutorial on using Octave to do scientific audio processing. The first part covers basic reading, writing, and playing of audio files. Part two covers synthesis of signals, plotting, and some basic transformations.  Modulation is the topic of the third part. If you prefer your tutorials on video, you can check out the video below.

We’ve talked about MATLAB before in the context of message cracking. Then again, some of the best signal processing is done by humans. If you don’t like Octave, you might try Scilab, another Linux package that is similar. There’s also Freemat, Sage, and Spyder. Of course, you can also run MATLAB under Linux.