AI Image Generator Twists In Response To MIDI Dials, In Real-time

July 30, 2024 by Donald Papp 28 Comments

MIDI isn’t just about music, as [Johannes Stelzer] shows by using dials to adjust AI-generated imagery in real-time. The results are wild, with an interactivity to them that we don’t normally see in such things.

[Johannes] uses Stable Diffusion‘s SDXL Turbo to create a baseline image of “photo of a red brick house, blue sky”. The hardware dials act as manual controls for applying different embeddings to this baseline, such as “coral”, “moss”, “fire”, “ice”, “sand”, “rusty steel” and “cookie”.

By adjusting the dials, those embeddings are applied to the base image in varying strengths. The results are generated on the fly and are pretty neat to see, especially since there is no appreciable amount of processing time required.

The MIDI controller is integrated with the help of lunar_tools, a software toolkit on GitHub to facilitate creating interactive exhibits. As for the image end of things, we’ve previously covered how AI image generators work.

The Last Instrument To Get Auto-Tuned

July 30, 2024 by Bryan Cockfield 14 Comments

Various decades have their musical signature, like the excessive use of synthesizers and hairspray in the 1980s pop music scene. Likewise, the early 2010s was marked by a fairly extreme use of autotune, a technology that allows sounds, especially vocals, to be shifted to precise pitches regardless of the pitch of the original source. In this dark era, a wide swath of instruments and voices on the charts were auto-tuned at some point, although we don’t remember this iconic instrument ever being featured among the annals of pitch-shifted pop music.

The auto-tuned kazoo created by [Guy Dupont] does its pitch corrections on-the-fly thanks to a built-in ESP-32-S3 microcontroller which, through a microphone inside the kazoo, listens for note of the musician’s hum and corrects it to the closest correctly pitched note. Once it identifies the note it outputs a kazoo-like pitch-corrected note from a small speaker, also hidden inside the instrument. It does this fast enough for live performances using the YIN fundamental frequency estimation algorithm. Not only can the kazoo be played directly, but thanks to the implementation of MIDI it can be used to control other synthesizers or be played through other means as a stand-alone synthesizer.

Much like the 80s, where the use of synthesizers relaxed from excessive use on nearly every instrument on every track throughout the decade to a more restrained use as the decade faded, so has autotune been toned down in most music to be more subtly applied. But like our enjoyment of heavily synthesized tunes outside the 80s like those by Daft Punk or The Weeknd, we can also appreciate something heavily auto-tuned outside of the 2010s like a stylized kazoo or a T-Pain-style guitar effects pedal.

Continue reading “The Last Instrument To Get Auto-Tuned” →

MIDI Controller In A Cubic Inch

July 27, 2024 by Bryan Cockfield 3 Comments

MIDI as a standard has opened up a huge world to any musician willing to use a computer to generate or enhance their playing and recording. Since the 80s, it has it has revolutionized the way music is produced and performed, allowing for seamless integration of digital instruments, automation of complex sequences, and unprecedented control over everything from production to editing. It has also resulted in a number of musical instruments that probably wouldn’t be possible without electronic help, like this MIDI instrument which might be the world’s smallest.

Fitting into a cubic inch of space, the tiny instrument’s volume is mostly taken up by the MIDI connector itself which was perhaps an acceptable size by 1980s standards but seems rather bulky today. A two-layer PCB split into three sections sandwiches the connector in place and boasts an ATtiny85 microcontroller and all the associated electronics needed to implement MIDI. Small threaded screws hold the platform together and provide each layer with a common ground. Four small pushbuttons at the top of the device act as the instrument’s keys.

The project’s creator (and Hackaday alum!) [Jeremy Cook] has it set up to play notes from a piano right now, but has also made the source code available so that any musical action can be programmed onto these buttons. Flexibility is perhaps MIDI’s greatest strength and why the standard has lasted for decades now, as it makes it fairly straightforward to build more comprehensive, easy-to-learn musical instruments or even musical instruments out of retro video game systems.

Continue reading “MIDI Controller In A Cubic Inch” →

A Simple Laser Harp MIDI Instrument

June 19, 2024 by Dave Rowntree 5 Comments

Craig Lindley is a technical author and a prolific maker of things. This simple project was his first attempt to create a laser harp MIDI device. While on vacation, Craig saw a laser harp with only three strings and decided to improve upon it by expanding it to twelve strings. The principle of operation is straightforward: twelve cheap diode laser modules aim a beam towards an LDR, which changes resistance if the light level changes when the beam is interrupted.

The controller is a simple piece of perf board, with a Wemos D1 mini ESP32 module flanked by some passives, a barrel socket for power, and the usual DIN connector for connecting the MIDI instrument. Using the ESP32 is a smart choice, removing all the need for configuration and user indication from the physical domain and pushing it onto a rarely-needed webpage. After a false start, attempting to use a triangular frame arrangement, [Craig] settled upon a simple linear arrangement of beams held within a laser-cut wooden box frame. Since these laser modules are quite small, some aluminium rod was machined to make some simple housings to push them into, making them easier to mount in the frame and keeping them nicely aligned with their corresponding LDR.

Sadly, the magnetic attachment method [Craig] used to keep the LDRs in place and aligned with the laser didn’t work as expected, so it was necessary to reach for the hot glue. We’ve all done that!

An interesting addition was using an M5 stack Unit-Synth module for those times when a proper MIDI synthesiser was unavailable. Making this luggable was smart, as people are always fascinated with laser harps. That simple internal synth makes travelling to shows and events a little easier.

Laser harps are nothing new here; we have covered plenty over the years. Like this nice build, which is more a piece of art than an instrument, one which looks just like a real harp and sounds like one, too, due to the use of the Karplus-Strong algorithm to mimic string vibrations.

Harmonic Table Keyboard Brings Old Idea Back To Life

June 17, 2024 by Bryan Cockfield 11 Comments

If you missed the introduction of the Axis-49 and Axis-64 keyboards by C-Thru Music, you’re definitely not alone. At the time it was a new musical instrument that was based on the harmonic table, but it launched during the Great Recession and due to its nontraditional nature and poor timing, the company went out of business. But the harmonic table layout has a number advantages for musicians over other keyboard layouts, so [Ben] has brought his own version of the unique instrument to life in his latest project.

Called the Midihex, the keyboard has a number of improvements over the version from C-Thru Music, most obviously its much larger 98 playable keys and five function keys. The keys themselves are similar to Cherry MX keys but which use Hall-effect sensors. This style of key allows the device to send continuous key position information to the host computer, and since this is a MIDI instrument, this capability allows it to support a MIDI protocol called MIDI Polyphonic Expression (MPE) which allows each note to be more finely controlled by the musician than a standard MIDI instrument. The PCB is powered by a Teensy 4.1 at the core.

For any musicians that haven’t tried out a harmonic table before, an instrument like this might be worth trying out. The layout provides easier chord and scale patterns, and for beginner musicians it can have a much shallower learning curve than other types of instruments. If you can’t find an original Axis-49 or Axis-64 anywhere to try out, though, we actually posted a teardown of one way back in 2009 when the company was still producing instruments.

Continue reading “Harmonic Table Keyboard Brings Old Idea Back To Life” →

2024 Business Card Challenge: Tiny MIDI Keyboard

June 6, 2024 by Bryan Cockfield 17 Comments

The progress for electronics over the past seven decades or so has always trended towards smaller or more dense components. Moore’s Law is the famous example of this, but even when we’re not talking about transistors specifically, technology tends to get either more power efficient or smaller. This MIDI keyboard, for example, is small enough that it will fit in the space of a standard business card which would have been an impossibility with the technology available when MIDI first became standardized, and as such is the latest entry in our Business Card Challenge.

[Alana] originally built this tiny musical instrument to always have a keyboard available on the go, and the amount of features packed into this tiny board definitely fits that design goal. It has 18 keys with additional buttons to change the octave and volume, and has additional support for sustain and modulation as well. The buttons and diodes are multiplexed in order to fit the IO for the microcontroller, a Seeed Studio Xiao SAMD21, and it also meets the USB-C standards so it will work with essentially any modern computer available including most smartphones and tablets so [Alana] can easily interface it with Finale, a popular music notation software.

Additionally, the project’s GitHub page has much more detail including all of the Arduino code needed to build a MIDI controller like this one. This particular project has perhaps the best size-to-usefulness ratio we’ve seen for compact MIDI controllers thanks to the USB-C and extremely small components used on the PCB, although the Starshine controller or these high-resolution controllers are also worth investigating if you’re in the market for compact MIDI devices like this one.

Continue reading “2024 Business Card Challenge: Tiny MIDI Keyboard” →

This MIDI BoomBox Takes Floppies

May 21, 2024 by Al Williams 11 Comments

You might have had a boombox back in the 1990s, but probably not like the Yamaha MDP-10. As [Nicole] explains, the odd little device played MIDI files from a floppy disk. Technically, it wasn’t truly a boombox because it lacked batteries, but it sure looks like one.

The box also had a MIDI input jack, but no output. For an antique gadget, it is pretty impressive, but maybe not much by today’s standards. Of course, what we really wanted to see was what was inside. [Nicole] doesn’t disappoint.

The boombox brains are a pair of Hitachi H8 3000-series CPUs. The boards actually looks surprisingly modern until you notice the lack of integration. There are separate ROMs, RAMs, a floppy drive controller, and, of course, MIDI chips. Apparently, opening the box up is a challenge so [Nicole] suggests not doing it unless necessary. We assume it went back together with no problems.

There are lots of tidbits about peculiarities in the device. There are also, of course, recordings of the output and some comparisons from other devices. A great look into an old and odd piece of gear.

Since it has an input jack, you could connect it to — oh, we don’t know — maybe some spoons? Or a hurdy-gurdy.