Electronic Glove Detects Sign Language

December 20, 2014 by Rick Osgood 11 Comments

A team of Cornell students recently built a prototype electronic glove that can detect sign language and speak the characters out loud. The glove is designed to work with a variety of hand sizes, but currently only fits on the right hand.

The glove uses several different sensors to detect hand motion and position. Perhaps the most obvious are the flex sensors that cover each finger. These sensors can detect how each finger is bent by changing the resistance according to the degree of the bend. The glove also contains an MPU-6050 3-axis accelerometer and gyroscope. This sensor can detect the hand’s orientation as well as rotational movement.

While the more high-tech sensors are used to detect most characters, there are a few letters that are similar enough to trick the system. Specifically, they had trouble with the letters R, U, and V. To get around this, the students strategically placed copper tape in several locations on the fingers. When two pieces of tape come together, it closes a circuit and acts as a momentary switch.

The sensor data is collected by an ATmega1284p microcontroller and is then compiled into a packet. This packet gets sent to a PC which then does the heavy processing. The system uses a machine learning algorithm. The user can train the it by gesturing for each letter of the alphabet multiple times. The system will collect all of this data and store it into a data set that can then be used for detection.

This is a great project to take on. If you need more inspiration there’s a lot to be found, including another Cornell project that speaks the letters you sign, as well as this one which straps all needed parts to your forearm.
Continue reading “Electronic Glove Detects Sign Language” →

Flex Sensing For A DIY Data Glove

August 11, 2014 by Matt Terndrup 5 Comments

cyber

[Cyber] has been testing out intuitive input methods for virtual reality experiences that immerse the user further into the virtual world than archaic devices like a keyboard or mouse would allow. One of his biggest interests so far was the idea of a data glove that interacts with an Arduino Uno to interface with a PC. Since commercial products are yet to exist on a readily available level, [Cyber] decided to build his own.

He started out with a tiny inertial measurement unit called a Pololu MinIMU-9 v2 that tracks orientation of the 3-axis gyro and accelerometer. The USB interface was soldered into place connecting the wires to an Arduino Uno. From there, he hooked up a flex sensor from Spectra Symbol (which were supposedly used in the original Nintendo Power Gloves) and demoed the project by tracking the movement of one of his fingers. As the finger bent, the output printed on the serial monitor changed.

[Cyber] still needs to mount a glove on this system and construct a proper positional tracking method so that physical movement will be mirrored in a simulation.

[Cyber’s] day job has had him busy these last few months, which has forced the project into a temporary hold. Recently though, [Cyber] has been an active member and an influence in the local Orange County VR scene helping to build a nice development culture, so we’re hoping to see more updates from him soon.

To view what he has done up to this point, click the link at the top of the page, and check out the video after the break:

Continue reading “Flex Sensing For A DIY Data Glove” →

Making Flex Sensors On The Cheap

June 4, 2012 by Brian Benchoff 17 Comments

When [Michelle] was making a sign language translation glove, she needed a bunch of flex sensors. These flex sensors cost about $10 a pop, meaning her budget for the project was eaten up by these bendy potentiometers. Since then, [Michelle] figured out a great way to make extremely inexpensive bend sensors using anti-static bags and masking tape, allowing her to start her project once again.

The build works by sandwiching Velostat plastic bags – the same electrically conductive bags all your components arrive in – between layers of masking tape. A jumper wires is attached to a strip of Velostat attached to a piece of masking tape. Between two of these anti-static/masking tape assemblies, another piece of Velostat is placed. After laminating all these pieces together, [Michelle] had a primitive yet very functional flexible potentiometer.

After attaching one of these flex sensors to an analog input of her dev board of choice, she had a wonderful and inexpensive flexible sensor. You can check out this sensor in action after the break.

Continue reading “Making Flex Sensors On The Cheap” →

Failed Kayaking Data Logger Is Something We Want To See Succeed

May 29, 2012 by Mike Szczys 17 Comments

How can your love of hobby electronics and your participation in the Canadian National Kayaking Team be combined? Why not use your technical know-how to provide a performance edge? [Geoff Clarke] decided to rig up a paddle for data capture to see if they could learn anything.

Here you can see that a series of flex sensors were applied to one of the business ends of the paddle. These are connected to a microcontroller which is constantly monitoring them and dumping the data onto an SD card. The design will provide about nine minutes of data before the storage is used up. That sounds like a number that might need improving. We could see this being useful to log a series of practice runs on the same course, but with different athletes. By graphing and comparing the data, you should be able to make observations about how the paddle is being held and when force is applied that could help the rest of the team improve.

But we’re way ahead of ourselves. The rig was given a premature test-run and the flex sensors were destroyed by the salt water. We wish this had worked out and hope that [Geoff] will give it another try after rethinking the water proofing.

Sign And Speak Glove

May 4, 2012 by Mike Szczys 10 Comments

This wire covered glove is capable of turning your hand gestures to speech, and it does so wirelessly. The wide range of sensors include nine flex sensors, four contact sensors, and an accelerometer. The flex sensors do most of the work, monitoring the alignment of the wearer’s finger joints. The contact sensors augment the flex sensor data, helping to differentiate between letters that have similar finger positions. The accelerometer is responsible for decoding movements that go along with the hand positions. They combine to detect all of the letters in the American Sign Language alphabet.

An ATmega644 monitors all of the sensors, and pushes data out through a wireless transmitter. MATLAB is responsible for collecting the data which is coming in over the wireless link. It saves it for later analysis using a Java program. Once the motions have been decoded into letters, they are assembled into sentences and fed into a text-to-speech program.

You’ve probably already guess that there’s a demo video after the break.

Continue reading “Sign And Speak Glove” →

Building A Flex Sensor From Component Packing Materials

February 28, 2012 by Mike Szczys 10 Comments

Hacks like this one don’t help us recover from extreme pack-rat behavior. Driving home the point that one should never throw anything away [Peter] built a flex sensor from component packing material. It uses the black conductive foam in which integrated circuits are sometimes embedded for shipping. Above you can see the grey rectangle which is the sensor itself. in the background of the image, each component used in the build is labelled except for the tape.

The project starts with the foam being cut to the appropriate size and thickness. He does the same with some aluminum foil, then rips tape strips to act as the enclosure. Fine wire from some cable shielding serves as the two conductors for the sensor. He attaches each wire to an upturned piece of tape, followed by the foil, and finally the foam. When the two halves are assembled in the video after the break, [Peter] hooks up his multimeter to show the change in resistance as the sensor is bent.

We think it will take a clever calibration algorithm to get this working reliably, but it’s no more troublesome than the optical flex sensors we saw in this links post. Continue reading “Building A Flex Sensor From Component Packing Materials” →

Wireless MIDI Piano Glove

November 7, 2011 by Brian Benchoff 9 Comments

Sometimes you just don’t have space for a baby grand. [Abdullah] got around this problem and built a virtual wireless MIDI piano. Unlike it’s inspiration, it’s not bad but we still love it.

[Abdullah] got his hands on some flex sensors and attached them to a glove. These resistive sensors are put through a voltage divider and sent to a microcontroller (a PIC16F778, we believe) and corresponding MIDI notes are chosen. These MIDI notes are sent to a computer and played over a speaker.

Right now, only a single arpeggio is coded into the microcontroller. Depending on which finger is bent shifts this arpeggio up and down the keyboard. That being said, the firmware can be easily modified to recognize standard piano fingering so chords can be played. The only issue is moving the hand up and down the keyboard.

[Abdullah] is planning on making his glove completely wireless with a microcontroller and battery sewn into the glove. Here’s to hoping he’ll keep us posted.

Check out [Abdullah]’s demo after the break.

Continue reading “Wireless MIDI Piano Glove” →