Humanoid Robot Listens To Music, Plays Along On His Theremin

robot_playing_theremin

Researcher and YouTube user [mspetitegeek] along with her lab mate [Tatsuhiko Itohara] have been fortunate enough to spend some time working with the HRP-2 humanoid robot from Kawada Industries. Their research has seemingly been focused on using the robot to create real-time interactions with humans for entertainment purposes, at the very least.

The program they created allows the HRP-2 to listen and watch its human counterpart while he plays the guitar in order to recognize a beat pattern. Once the robot catches on, it plays along on his Theremin, matching both notes and rhythm perfectly. Since the human operator is clearly playing at a fairly relaxed pace, we are curious to see a demonstration where the robot required to match a snappier tune – it could be quite interesting.

In the meantime, we’re content to just sit back and enjoy the Mogwai-esque tones of the HRP-2 rocking the Theremin.

Keep reading to see a short video of the HRP-2 in action.

[youtube=http://www.youtube.com/watch?v=-fuOdhMeF3Y&w=470]

13 thoughts on “Humanoid Robot Listens To Music, Plays Along On His Theremin

  1. Who on earth came up with this? It’s an interesting and fun idea, something you might discuss over lunch and have a laugh about, but these guys actually thought this would be worth the considerable time and effort to do? Why? Am I missing something here, some greater plan this fits into?

    Not trying to be overly negative here – just amazed someone could be bothered to do this.

    1. “Their research has seemingly been focused on using the robot to create real-time interactions with humans for entertainment purposes, at the very least.”

      This is an example of entertainment. Music at this level isn’t complex as it only plays a few tones/frequencies in response to a few environmental specific tones/frequencies. The reason why this is so cool, is if this technology is able react in many different ways (letters->words->sentences) in a combinatorial response to many different environmental sounds, then we could have real-time conversation with a robot. It would feel like talking to someone who knows every fact, if lets say the robot was able to access the internet and answer any question you had. Then, you could go home smoke a joint and jam with your robot to any genre of music. IMAGINE THAT SHIT!

  2. It’s a beat tracker, not pitch tracker. With the first few innocuous twangs of the guitar, the system picked up the tempo and beat time and started playing.

    As for why we did it, try finding another instrument a humanoid can play! (don’t say drum… ;)

Leave a Reply

Please be kind and respectful to help make the comments section excellent. (Comment Policy)

This site uses Akismet to reduce spam. Learn how your comment data is processed.