Want Gesture-Tracking? All You Have To Do Is Lift Your Finger.

Watching Tony Stark wave his hands to manipulate projected constructs is an ever-approaching reality — at least in terms of gesture-tracking. Lift — a prototype built by a team from UC Irvine and FX Palo Alto Laboratory — is able to track up to ten fingers with 1.7 mm accuracy!

Lift’s gesture-tracking is achieved by using a DLP projector, two Arduino MKR1000s, and a light sensor for each digit. Lift’s design allows it to work on virtually any flat surface; the projected image acts as a grid and work area for the user. As their fingers move across the projected surface, the light sensors feed the information from the image to the Arduinos, which infers the location of each finger and translate it into a digital workspace. Sensors may also be mounted on other objects to add functionality.

So far, the team has used Lift as an input device for drawing, as well as using it to feign gesture controls on a standard laptop screen. The next step would be two or more projectors which would allow Lift to function fully and efficiently in three dimensions and directly interacting with projected media content. Can it also operate wirelessly? Yes. Yes, it can.

While we don’t have Tony Stark’s hologram workstation quite yet, we can still play Tetris, fly drones, and mess around with surgical robots.

Ardu McDuino Plays The Bagpipes

To “pipe in” the new year, [John] decided to build a bagpipe-playing robot. Unlike other instrument-playing robots that we’ve seen before, this one is somewhat anatomically correct as well. John went the extra mile and 3D printed fingers and hands to play his set of pipes.

The brains of the robot are handled by an Arduino Mega 2560, which drives a set of solenoids through a driver board. The hands themselves are printed from the open source Enabling the Future project which is an organization that 3D prints prosthetic hands for matched recipients, especially people who can’t otherwise afford prosthetics. He had to scale up his hands by 171% to get them to play the pipes correctly, but from there it was a fairly straightforward matter of providing air to the bag (via a human being) and programming the Arduino to play a few songs.

The bagpipe isn’t a particularly common instrument (at least in parts of the world that aren’t Scottish) so it’s interesting to see a robot built to play one. Of course, your music-playing robot might be able to make music with something that’s not generally considered a musical instrument at all. And if none of these suit your needs, you can always build your own purpose-built semi-robotic instrument as well.

Continue reading “Ardu McDuino Plays The Bagpipes”

Casting a hand part 1

[Bil’s] Quest For A Lost Finger: Episode I

A little over a year ago I had a semi-gruesome accident; I stepped off of a ladder and I caught my wedding ring on a nail head. It literally stripped the finger off the bone. This was in spite of me being a safety-freak and having lived a whole second life doing emergency medicine and working in trauma centers and the like. I do have trauma center mentality which means, among other things, that I know you can’t wind the clock back.

hand9A few seconds make an incredible differences in people’s lives. Knowing that it couldn’t be undone, I stayed relaxed and in the end I have to say I had a good time that day as I worked my way through the system (I ended  up in a Philadelphia trauma center with a nearby hand specialist) as I was usually the funniest guy in the room. Truth be told they ask incredibly straight questions like”are you right handed?”  “Well I am NOW”.

So now I could really use a bit of a body hack, having seen the X-Finger on Hackaday long before I knew that I would one day work with them, I was hoping that we could get one to work for me. In speaking with a couple of the mechanical engineers on the Hackaday staff we decided to get [James Hobson] and [Rich Bremer] involved and that the best way to do it was to get a casting of my injured hand out to them.

 

Continue reading “[Bil’s] Quest For A Lost Finger: Episode I”

Open Source Finger Prosthesis

Here’s a project that is striving to develop a set of open source finger prosthesis. They are aimed at patients who have partial amputations. This means that part of the digit remains and can be used as the motive force behind a well designed mechanical prosthesis like you see above. This uses levers, pulleys, and wire to move a gripper in much the same way the pad of a pointer finger works. There’s even a video (embedded after the jump) which shows it being used to grab a toothpick from a dispenser… pretty impressive. This is similar to the prosthesis we saw in August which managed to work without pulleys and wire.

This isn’t limited to fingers. The same posts that shows off the unit seen above also includes a prosthetic thumb. The leverage for that design is provided by a woven nylon strap which attaches to a bracelet on the wrist.

Continue reading “Open Source Finger Prosthesis”

Magic Finger Input Device Is A Camera On Your Finger Tip

What if we could do away with mice and just wear a thimble as a control interface? That’s the concept behind Magic Finger. It adds as movement tracking sensor and RGB camera to your fingertip.

Touch screens are great, but what if you want to use any surface as an input? Then you grab the simplest of today’s standard inputs: a computer mouse. But take that one step further and think of the possibilities of using the mouse as a graphic input device in addition to a positional sensor. This concept allows Magic Finger to distinguish between many different materials. It knows the difference between your desk and a piece of paper. Furthermore, it opens the door to data transfer through a code scheme they call a micro matrix. It’s like a super small QR code which is read by the camera in the device.

The concept video found after the break shows off a lot of cool tricks used by the device. Our favorite is the tablet PC controlled by moving your finger on the back side of the device, instead of interrupting your line of sight and leaving fingerprints by touching the screen.

Continue reading “Magic Finger Input Device Is A Camera On Your Finger Tip”

Replacing A Finger Or An Arm In The Hacker Tradition

Just a few weeks ago we were wondering if we’d try to build our own prosthesis if we were ever to lose a limb. This pair of hacks answers that query with a resounding “YES!”.

To the right is a replacement pointer finger. The missing digit took the first two knuckles with it, but there’s enough left to easily interface with this creation. It’s a mechanically clever assembly that moves as you would expect the original to. See for yourself after the break. It seem the maker intended to mold silicone around the structure but never got around to posting an update video.

On the left we have a chinese man who lost his arms while fishing. It seems they were using homemade bombs instead of nets and one went off prematurely. Since then he’s constructed several different prosthetic arms, each with its own special purpose. This one has a saw connected to it but these two write ups on the man show images of him using a fork and wielding a hammer.

Continue reading “Replacing A Finger Or An Arm In The Hacker Tradition”

Excuse Me, My Pinky Is Ringing

We get a lot of email challenging us to hack things. Sometimes we ignore them, other times we send some words of encouragement. But this time around we thought [Tait] had really come up with a great hack; to build a Bluetooth handset into his prosthetic finger. He hasn’t done much hacking in the past and was wondering if we could put out a challenge to our readers to make this happen. After a bit of back-and-forth brainstorming he decided to take on the challenge himself and was met with great success.

Like other Bluetooth handset hacks [Tait] started with a simple ear-mounted module. He extended the volume button with a piece of plastic and placed it under the battery. A couple of wooden matchsticks space the battery just enough so that it can be squeezed to adjust the volume level. He then extended the speaker with some wire. Next, he used the Oogoo recipe from our previous post to mold a false-finger and a thumb-ring. The PCB and battery fit in the finger, which places the microphone near a hole in the pad of the plastic pinky. The thumb ring houses the speaker to finish the look. Don’t miss the photos [Tait] sent in after the break.

Continue reading “Excuse Me, My Pinky Is Ringing”