Sensor Glove Translates Sign Language

January 13, 2023 by Lewin Day 17 Comments

Sign language is a language that uses the position and motion of the hands in place of sounds made by the vocal tract. If one could readily capture those hand positions and movements, one could theoretically digitize and translate that language. [ayooluwa98] built a set of sensor gloves to do just that.

The brains of the operation is an Arduino Nano. It’s hooked up to a series of flex sensors woven into the gloves, along with an accelerometer. The flex sensors detect the bending of the fingers and the gestures being made, while the accelerometer captures the movements of the hand. The Arduino then interprets these sensor signals in order to match the user’s movements up with a pre-stored list of valid signs. It can then transmit out the detected language via a Bluetooth module, where it is passed to an Android phone for translation via text-to-speech software.

The idea of capturing sign language via hand tracking is a compelling one; we’ve seen similar projects before, too. Meanwhile, if you’re working on your own accessibility projects, be sure to drop us a line!

Morse Keyboard Communicates With The Blink Of An Eye

March 18, 2022 by Kristina Panos 4 Comments

Most of us use our hands to interface with computers, but the human body is capable of many types of input other than that of fingers and feet. But what about people who can’t use their extremities and don’t have a voice? For their sake, it’s time to get creative.

[Michael Paul Coder] has made a way to type simply by blinking in Morse code. Those of you with long memories may recall Lucid Scribe, where he was attempting to document lucid dreaming experiments by detecting rapid eye movements with an accelerometer and triggering his computer to play music. This would in turn notify [Michael] that he was in fact dreaming and was safe to tie a cape around his neck and take a flying leap from a tall building.

Whereas [Michael]’s creation needed a commercial EEG device before, he’s now made it work with just an old webcam thanks to the new trans-consciousness messaging protocol, which operates by using facial detection and then interpreting the amount of changed pixels between video frames. Be sure to check it out in action after the break.

You know how much we love assistive technology around here — just two years ago, the Byte took top honors in The Hackaday Prize.

Continue reading “Morse Keyboard Communicates With The Blink Of An Eye” →

The Coolest Controller Mod, Hands Down

February 6, 2022 by Kristina Panos 15 Comments

Video games are a great way to relax, and sometimes get your heart rate up at the same time. But unless you’re playing something like Dance Dance Revolution, the controls pretty much always require the use of both hands. Even the old Atari controller benefited from using the other hand for support.

But what if you don’t have the use of both hands? Or you have a repetitive stress injury? Or you just want to eat cheese curls with chopsticks while you play? [Akaki Kuumeri] has you covered with one of the hands-down greatest uses for 3D printing we’ve seen — a PlayStation DualShock 4 controller modified for one-handed use. If this looks familiar, it may be because [Akaki] made a PS5 controller version a while back, but who can get one of those, anyway?

Though [Akaki] does most of the demonstrating in the video below with their left hand, they were cool enough to make a right-handed version as well. In the left-handed version, the symbol buttons and right trigger are actuated with the left hand, and the right joystick is used by moving the whole controller against your leg, the table, the arm of the couch, or whatever you wish.

[Akaki] even designed some optional pieces, including a leg strap. The right-hand version of course does the D-pad instead. But what should the order of the arrow buttons be? After much contemplation, [Akaki] settled on the standard DDR configuration of ←↓↑→.

We love that the symbols are made from raw filament pressed into grooves, and think it’s totally awesome that this is made to be attached to the controller and removed with one hand. Check out the video below to see it in action with a handful of games.

Continue reading “The Coolest Controller Mod, Hands Down” →

Assistive Tech And Video Games

December 7, 2021 by Orlando Hoilett 6 Comments

Assistive technologies have a pretty big presence here on Hackaday, and this hack is nothing short of interesting. [kerchoo_22] is working on a hands-free video game controller as a final project for her engineering class and we think it’s worth sharing.

The basic premise of the circuit is pretty simple. She DIY’d a few contact switches using conductive plates made of cardboard, duct tape, and aluminum foil. The output of the switch is read by analog input pins on an Arduino Leonardo. When the switches are off, the analog input pins are pulled HIGH using 1 MegaOhm resistors. But when the user hits their head on one of the four conductive pads, the switch is engaged, and the analog input pins are shorted to ground.

The Arduino Leonardo, having a native USB port, is able to directly emulate a keyboard. Each conductive pad is mapped to a different key press corresponding to different functions within the game. Left, right, shoot, etc. And there you have it, gameplay without using hands or a controller!

Now, it seems as though [kerchoo_22] put an appropriate amount of cushion on the head pads, so there probably isn’t much danger of a concussion. Either way, you can never be too careful.

Seeing-Eye Shoes Pair Computer Vision With Haptic Feedback

May 12, 2021 by Kristina Panos 21 Comments

Over the years, we’ve seen plenty of projects that use ultrasonic or time-of-flight sensors as object detection methods for the visually impaired. Ultrasonic sensors detect objects like sonar — they send sound pulses and measure the time it takes for the signal to bounce off the object and come back. Time-of-flight sensors do essentially the same thing, but with infrared light. In either case, the notifications often come as haptic feedback on the wrist or head or whatever limb the ultrasonic module is attached to. We often wonder why there aren’t commercially-made shoes that do this, but it turns out there are, and they’re about to get even better.

The shoe’s view — safe walking space is delimited with color. Image via TU Graz

Today, Tec-Innovation makes shoes with ultrasonic sensors on the toes that can detect objects up to four meters away. The wearer is notified of obstacles through haptic feedback in the shoes as well as an audible phone notification via Bluetooth. The company teamed up with the Graz University of Technology in Austria to give the shoes robot vision that provides even better detail.

Ultrasonic is a great help, but it can’t detect the topography of the obstacle and tell a pothole from a rock from a wall. But if you have a camera on both feet, you can use the data to determine obstacle types and notify the user accordingly. These new models will still have the ultrasonic sensors to do the initial object detection, and use the cameras for analysis.

Whenever they do come out, the sensors will all be connected through the app, which paves the way for crowdsourced obstacle maps of various cities. The shoes will also be quite expensive. Can you do the same thing for less? Consider the gauntlet thrown!

We could all use some navigational help sometimes. Don’t want to look like a tourist? Get turn-by-turn directions in the corner of your eye.

Thanks for the tip, [Qes]!

Inputs Of Interest: The OrbiTouch Keyless Keyboard And Mouse

October 12, 2020 by Kristina Panos 19 Comments

I can’t remember how exactly I came across the OrbiTouch keyboard, but it’s been on my list to clack about for a long time. Launched in 2003, the OrbiTouch is a keyboard and mouse in one. It’s designed for people who can’t keyboard regularly, or simply want a different kind of experience.

The OrbiTouch was conceived of by a PhD student who started to experience carpal tunnel while writing papers. He spent fifteen years developing the OrbiTouch and found that it could assist many people who have various upper body deficiencies. So, how does it work?

It’s Like Playing Air Hockey with Both Hands

To use this keyboard, you put both hands on the sliders and move them around. They are identical eight-way joysticks or D-pads, essentially. The grips sort of resemble a mouse and have what looks like a special resting place for your pinky.

One slider points to groups of letters, numbers, and special characters, and the other chooses a color from a special OrbiTouch rainbow. Pink includes things like parentheses and their cousins along with tilde, colon and semi-colon. Black is for the modifiers like Tab, Alt, Ctrl, Shift, and Backspace. These special characters and modifiers aren’t shown on the hieroglyphs slider, you just have to keep the guide handy until you memorize the placement of everything around the circle.

You’re gonna need a decent amount of desk space for this. Image via OrbiTouch

The alphabet is divided up into groups of five letters which are color-coded in rainbow order that starts with orange, because red is reserved for the F keys. So for instance, A is orange, B is yellow, C is green, D is blue, E is purple, then it starts back over with F at orange. If you wanted to type cab, for instance, you would start by moving the hieroglyph slider to the first alphabet group and the color slider to green.

Continue reading “Inputs Of Interest: The OrbiTouch Keyless Keyboard And Mouse” →

Hackaday Links: September 27, 2020

September 27, 2020 by Dan Maloney 15 Comments

Hardly a week goes by without a headline screaming about some asteroid or another making a close approach to Earth; it’s only by reading the fine print that we remember what an astronomer’s definition of “close” means. Still, 2020 being what it is, it pays to stay on top of these things, and when you do the story can get really interesting. Take asteroid 2020 SO, a tiny near-Earth asteroid that was discovered just last week. In a couple of weeks, 2020 SO will be temporarily captured into Earth orbit and come with 50,000 km near the beginning of December. That’s cool and all, but what’s really interesting about this asteroid is that it may not be a rock at all. NASA scientists have reverse-engineered the complex orbit of the object and found that it was in the vicinity of Earth in late 1966. They think it may be a Centaur booster from the Surveyor 2 moon mission, launched in September 1966 in the runup to Apollo. The object will be close enough for spectral analysis of its. surface; if it’s the booster, the titanium dioxide in the white paint should show up loud and clear.

Lasers are sort of forbidden fruit for geeks — you know you can put an eye out with them, and still, when you get your hands on even a low-power laser pointer, it’s hard to resist the urge to shine it where you shouldn’t. That includes into the night sky, which as cool as it looks could be bad news for pilots, and then for you. Luckily, friend of Hackaday Seb Lee-Delisle has figured out a way for you to blast lasers into the night sky to your heart’s content. The project is called Laser Light City and takes place in Seb’s home base of Brighton int he UK on October 1. The interactive installation will have three tall buildings with three powerful lasers mounted on each; a smartphone app will let participants control the direction, shape, and color of each beam. It sounds like a load of fun, so check it out if you’re in the area.

We got an interesting story from a JR Nelis about a quick hack he came up with to help his wife stay connected. The whole post is worth a read, but the short version of the story is that his wife has dementia and is in assisted living. Her landline phone is her social lifeline, but she can’t be trusted with it, lest she makes inappropriate calls. His solution was to modify her favorite cordless phone by modifying the keypad, turning it into a receive-only phone. It’s a sad but touching story, and it may prove useful to others with loved ones in similar situations.

We pay a lot of attention to the history of the early computer scene, but we tend to concentrate on computers that were popular in North America and the UK. But the Anglo-American computers were far from the only game in town, and there’s a new effort afoot to celebrate one of the less well-known but still important pioneer computers: the Galaksija. Aside from having a cool name, the Yugoslavian Z80 computer has a great story that will be told in documentary form, as part of the crowdsourced Galaksija project. The documentary stars our own Voja Antonic, who was key to the computer’s development. In addition to the film, the project seeks to produce a replica of the Galaksija in kit form. Check out the Crowd Supply page and see if it’s something you’re willing to back.

There’s an interesting new podcast out there: the Pick, Place, Podcast. Hosted by Chris Denney and Melissa Hough, it comes out every other week and is dedicated to the electronic assembly industry. They’ve currently got eight episodes in the can ranging from pick and place assembly to parts purchasing to solder paste printing. If you want to learn a little more about PCB assembly, this could be a real asset. Of course don’t forget to make time for our own Hackaday Podcast, where editors Mike and Elliot get together to discuss the week in hardware hacking.