Researchers at Google have posed themselves an interesting problem to solve: mastering the piano. However, they’re not trying to teach themselves, but a pair of simulated anthropomorphic robotic hands instead. Enter RoboPianist.
The hope is that the RoboPianist platform can help benchmark “high-dimensional control, targeted at testing high spatial and temporal precision, coordination, and planning, all with an underactuated system frequently making-and-breaking contacts.”
If that all sounds like a bit much to follow, the basic gist is that playing the piano takes a ton of coordination and control. Doing it in a musical way requires both high speed and perfect timing, further upping the challenge. The team hopes that by developing control strategies that can master the piano, they will more broadly learn about techniques useful for two-handed, multi-fingered control. To that end, RoboPianist models a pair of robot hands with 22 actuators each, or 44 in total. Much like human hands, the robot hands are underactuated by design, meaning they have less actuators than their total degrees of freedom.
If you’ve ever seen a human-like robot hand pick something up, you’ve probably noticed how slow and ungainly they are. With so many joints to control, making a hand work is a tough task. Learning to play the piano is thus an excellent benchmarking test to develop these techniques. The project paper highlights a variety of methods the researchers have used to train RoboPianist to play the instrument. It’s not great yet; you’d certainly make excuses if RoboPianist asked you to come to a gig. But it can definitely play the piano to a basic degree, that’s for sure.
The work is available on Github for those that wish to dive deeper, while there’s also a live demo you can play with in a browser. In the meantime, you might like to explore other roboticized efforts to play the piano. Video after the break.
The hands are floating with no support; this is just an animation.
Yeah, disappointing.
This is a solved problem, so probably worth skipping im this simulation.
It says “stimulation” right in the title.
So, the “hands” are intended for remote sex?
Great! It’s not enough that Hollywood script writers are threatened by AI, now the entire music world will have similar worries. /s
But I suppose if the robots are eventually going to take over the entire surgical suite of our hospitals, it’s to our meat sacks’ benefit to have robot hands demonstrate reasonable articulation.
did you hear the joke about the robopianist?
Piano, try the violin or oboe. Why stop at a human with ten happy fingers? Duets? No! All 88 in operation at any time. Oh! They did it more than a century ago, and it didn’t even use electricity. The worlds first digital music publishing as well. The player piano. Music teachers said it would ruin music. Then there MIDI players too. It’s that Big Brain we gota look out for.
Excellent! But can it play Rush E?
How long till it gets diverted to lewd purposes like that creepy physical robot hand that isn’t fooling anyone. You know that thing went missing a couple of times for at-home testing.