A Minority Report Arduino-Based Hand Controller

Movies love to show technology they can’t really build yet. Even in 2001: A Space Oddessy (released in 1968), for example, the computer screens were actually projected film.  The tablet they used to watch the news looks like something you could pick up at Best Buy this afternoon. [CircuitDigest] saw Iron Man and that inspired him to see if he could control his PC through gestures as they do on that film and so many others (including Minority Report). Although he calls it “virtual reality,” we think of VR as being visually immersed and this is really just the glove, but it is still cool.

The project uses an Arduino on the glove and Processing on the PC. The PC has a webcam which tracks the hand motion and the glove has two Hall effect sensors to simulate mouse clicks. Bluetooth links the glove and the PC. You can see a video of the thing in action, below.

The system requires calibration where you show it the object you want to track (a bright blue disk in the demo). The object apparently needs to be a different color from other objects in the camera’s field of view. That also means the object has to stay in view, so don’t get carried away thinking about wild flicking gestures with rotating palms.

If you search Hackaday for “gestures” you’ll see that people have done everything “by hand” from play Tetris to driving a car. There’s a lot of different techniques in use, too, ranging from radar to repurposed Leap controllers.

14 thoughts on “A Minority Report Arduino-Based Hand Controller

  1. This is the kind of exhausted project I’d expect a highschool freshman “3l1t3 h@xx0r” to manage in an hour. He even used the completely innappropriate label of “virtual reality,” a nice attention-grabbing buzzword. Though I suppose HaD may have been spoiling me with interesting content as of late, and this simply pales in comparison.

    1. I take offense to that! At some point we all thought we were 3l1t3 h@xx0rz before the world taught us to keep our head down and condem people for their overuse of buzzwords.

    1. This just needs to be polished up a bit. You could build it into a watch & stylish glove and walk around with your swanky supervillan-esque piece of junk. Quality of design is everything.

  2. …and like all these wave your hands in the air computer control systems it’ll never get any commercial traction due to the same problem they all have. They’re tiring to use.

    Unless you’re an orchestra conductor, nobody’s job involves lots of holding an arm out in the air and waving it about for long periods of time.

Leave a Reply

Please be kind and respectful to help make the comments section excellent. (Comment Policy)

This site uses Akismet to reduce spam. Learn how your comment data is processed.