The Ultimate MIDI Wind Controller Is The Human Voice

October 28, 2018 by Brian Benchoff 9 Comments

When it comes to music, the human voice is the most incredible instrument. From Tuvan throat singing to sopranos belting out an aria, the human vocal tract has evolved over millions of years to be the greatest musical instrument. We haven’t quite gotten to the point where we can implant autotune in our vocal cords, but this project for the Hackaday Prize aims to be a bridge between singers and instrumentalists. It’s a hands-free instrument that relies on vocal gesture sensing to drive electronic musical instruments.

The act of speaking requires dozens of muscles, and of course no device that measures how the human vocal tract is shaped will be able to measure all of them, but the Multiwind does manage to measure breathing in, breathing out, the shape of the lower lip, the upper lip, and its own tilt, giving it far more feedback than any traditional wind instrument. It does this with IMUs and a mouthpiece mounted on a mount that is seemingly inspired by one of those hands-free harmonica neck mounts.

The output for this device is MIDI, although the team behind this build already has data streaming to an instance of Max, and once you have that, you have every musical instrument imaginable. It’s an innovative musical instrument, and something we’re really excited to see the results of.

With Grinning Keyboard And Sleek Design, This Synth Shows It All

October 28, 2018 by Donald Papp 24 Comments

Stylish! is a wearable music synthesizer that combines slick design with stylus based operation to yield a giant trucker-style belt buckle that can pump out electronic tunes. With a PCB keyboard and LED-surrounded inset speaker that resembles an eyeball over a wide grin, Stylish! certainly has a unique look to it. Other synthesizer designs may have more functions, but certainly not more style.

The unit’s stylus and PCB key interface resemble a Stylophone, but [Tim Trzepacz] has added many sound synthesis features as well as a smooth design and LED feedback, all tied together with battery power and integrated speaker and headphone outputs. It may have been originally conceived as a belt buckle, but Stylish! certainly could give conference badge designs a run for their money.

The photo shown is a render, but a prototype is underway using a milled PCB and 3D printed case. [Tim]’s Google photo gallery has some good in-progress pictures showing the prototyping process along with some testing, and his GitHub repository holds all the design files, should anyone want a closer look under the hood. Stylish! was one of the twenty finalists selected for the Musical Instrument Challenge portion of the 2018 Hackaday Prize and is therefore one of the many projects in the running for the grand prize!

Piano Genie Trained A Neural Net To Play 88-Key Piano With 8 Arcade Buttons

October 27, 2018 by Steven Dufresne 5 Comments

Want to sound great on a Piano using only your coding skills? Enter Piano Genie, the result of a research project from Google AI and DeepMind. You press any of eight buttons while a neural network makes sure the piano plays something cool — compensating in real time for what’s already been played.

Almost anyone new to playing music who sits down at a piano will produce a sound similar to that of a cat chasing a mouse through a tangle of kitchen pots. Who can blame them, given the sea of 88 inexplicable keys sitting before them? But they’ll quickly realize that playing keys in succession in one direction will produce sounds with consistently increasing or decreasing pitch. They’ll also learn that pressing keys for different lengths of times can improve the melody. But there’s still 88 of them and plenty more to learn, such as which keys will sound harmonious when played together.

With Pinao Genie, gone are the daunting 88 keys, replaced with a 3D-printed box of eight arcade-style buttons which they made by following this Adafruit tutorial. A neural network maps those eight buttons to something meaningful on the 88-key piano keyboard. Being a neural network, the mapping isn’t a fixed one-to-one or even one-to-many. Instead, it’s trained to play something which should sound good taking into account what was play previously and won`t necessarily be the same each time.

To train it they use data from the approximately 1400 performances of the International Piano e-Competition. The result can be quite good as you can see and hear in the video below. The buttons feed into a computer but the computer plays the result on an actual piano.

For training, the neural network really consists of two networks. One is an encoder, in this case a recurrent neural network (RNN) which takes piano sequences and learns to output a vector. In the diagram, the vector is in the middle and has one element for each of the eight buttons. The second network is the decoder, also an RNN. It’s trained to turn that eight-element vector back into the same music which was fed into the encoder.

Once trained, only the decoder is used. The eight-button keyboard feeds into the vector, and the decoder outputs suitable notes. The fact that they’re RNNs means that rather than learning a fixed one-to-many mapping, the network takes into account what was previously played in order to come up with something which hopefully sounds pleasing. To give the user a little more creative control, they also trained it to realize when the user is playing a rising or falling melody and to output the same. See their paper for how the turned polyphonic sound into monophonic and back again.

If you prefer a different style of music you can train it on a MIDI collection of your own choosing using their open-sourced model. Or you can try it out as is right now through their web interface. I’ll admit, I started out just banging on it, producing the same noise I would get if I just hammered away randomly on a piano. Then I switched to thinking of making melodies and the result started sounding better. So some music background and practice still helps. For the video below, the researcher admits to having already played for a few hours.

This isn’t the first project we’ve covered by these Google researchers. Another was this music synthesizer again using neural networks but this time with a Raspberry Pi. And if our discussion of recurrent neural networks went a bit over your head, check out our overview of neural networks.

Continue reading “Piano Genie Trained A Neural Net To Play 88-Key Piano With 8 Arcade Buttons” →

Chiptunes In An Altoids Tin

October 27, 2018 by Brian Benchoff 8 Comments

For [Dejan]’s entry to the Musical Instrument Challenge in this year’s Hackaday Prize, he’s tapping into some of the great work that has been done over the years to bring bleeps and bloops to the masses. He’s building a drum machine, a bass synth, and an arpeggiator that fits in your pocket, in a handy form factor that fits in an Altoids tin. It’s the FATCAT Altoids Tin Mod Tracker.

This is a simple build meant to fit in an Altoids tin, so you’re not getting a whole lot of hardware here. There’s a battery, there’s a boost circuit, and there’s a single chip, an ATtiny84. This tiny little microcontroller is the heart of the box, able to provide a drum track with a kick, snare, and a closed and open high hat. There’s a bass with a simple square wave and portamento, and an arp track that can be used as a lead or arpeggiated chords. All of this is programmed in C and uploaded straight to the chip.

The ATtiny series of microcontrollers are fairly popular for various means and methods of creating square wave bleeps and bloops. We’ve seen them become a MIDI synth that fits inside a MIDI jack, and we’ve seen how much chiptune goodness you can fit in thirty two bytes of RAM. Cornell even had a spat of rickroll vandalism with a coin cell throwie built on an ATtiny85. Anything that puts more ATtiny chiptunes into the hands of more people is great in our books, and this Altoids tin synth is just the thing.

You can check out a demo of the FATCAT below.

Continue reading “Chiptunes In An Altoids Tin” →

Looks Like A Glove, Plays Like A Musical Instrument

October 25, 2018 by Donald Papp 8 Comments

The GePS is a musical project that shows how important integration work is when it comes to gesture controls. Creators [Cedric Spindler] and [Frederic Robinson] demonstrate how the output of a hand-mounted IMU (Inertial Measurement Unit) and magnetometer can be used to turn motion, gestures, and quick snap movements into musical output. The GePS is designed to have enough repeatability and low enough latency that feedback is practically immediate. As a result, it can be used and played like any other musical instrument that creates sound from physical movements in a predictable way. It’s not unlike a Theremin in that way, but much more configurable.

To do this, [Cedric] and [Frederic] made GePS from a CurieNano board (based on Intel’s Curie, which also has the IMU on-board) and an XBee radio for a wireless connection to software running on a computer, from which the sounds are played. The device’s sensitivity and low lag means that even small movements can be reliably captured, meaning that the kind of fluid and complex movements that hands do every day can be used as the basis for playing sounds with immediate feedback. In a very real sense, the glove-based GePS is an experimental kind of new instrument, which makes it a fascinating contender for the Musical Instrument Challenge portion of the 2018 Hackaday Prize.

Hurdy-Gurdy Gets Modernized With MIDI Upgrades

October 25, 2018 by Bryan Cockfield 17 Comments

If you’ve never heard a hurdy-gurdy before, you’re in for a treat. Not many people have, since they’re instruments which are uncommon outside of some eastern European communities. Think of a violin that replaces the bow with a hand-cranked wheel, and adds some extra strings that function similar to drones on a bagpipe. The instrument has been around for hundreds of years, but now it’s been given an upgrade via the magic of MIDI.

All of these new features come from [Barnaby Walters] who builds hurdy-gurdys by hand but has recently been focusing on his MIDI interface. The interface can do pitch-shifting polyphony, which allows the instrument to make its own chords and harmonies. It also has a hybrid poly synthesizer, which plays completely different sounds, and can layer them on top of one another. It can also split the keyboard into two instruments, where the top half plays one sound and the bottom half another. It’s an interesting take on an interesting instrument, and the video is definitely worth a look.

The hurdy-gurdy isn’t a commonly used instrument for hacking compared to something like drums or the violin, of course. In fact we had to go back over ten years to find any other articles featuring the hurdy-gurdy, the Furby Gurdy. It was an appropriately named instrument.

Thanks to [baldpower] for the tip!

Continue reading “Hurdy-Gurdy Gets Modernized With MIDI Upgrades” →

This Ukulele Does Chiptunes, And Not Just Because It’s Made Out Of A Game Boy

October 24, 2018 by Brian Benchoff 15 Comments

When you think about singer-songwriters, the name Bob Dylan might come to your mind. You might think about Jeff Buckley, you might think about Hank Williams, Springsteen, David Bowie, or Prince. You’d be wrong. The greatest singer-songwriter of all time is Tiny Tim, the guy who looks like Weird Al traveled in time and did a cameo in Baker-era Doctor Who. Tiny Tim had the voice of an angel, because Mammon and Belial were angels too, I guess. Tiny Tim is also the inspiration behind the current resurgence of the ukulele, the one thing keeping the stringed instrument industry alive today.

Even though Tiny Tim passed in 1996, he would have loved to see this project that brings the ukulele into the late 20th century. It’s a Game Boy, DMG-01, transformed into a playable musical instrument. It’s a functional uke, but it also has electronics to turn this into a chiptune machine.

The first goal of this project was to build a functional ukulele out of a Game Boy case. This was simple enough — the neck was 3D printed, the bridge was screwed in, and the case of the Game Boy was reinforced with some PCB material. So far, this is nothing new; you can get a model for a 3D printed ukulele on Thingiverse.

The second goal of this project was to make this ukulele into a chiptune machine. This means designing a pickup for the strings, and since these are nylon you’re not going to do a magnetic pickup on a ukulele. The first solution was an IR reflectance sensor, which worked but had too high of a power draw. The better solution was a standard flex pressure sensor, which worked well enough. This signal is distorted into a square wave that gives a surprisingly Game Boy-like sound. You can check out the video demo below.

Continue reading “This Ukulele Does Chiptunes, And Not Just Because It’s Made Out Of A Game Boy” →