Hackaday Prize Entry: LipSync, Smartphone Access For Quadriplegic People

For most of us, our touch-screen smartphones have become an indispensable accessory. Without thinking we tap and swipe our way through our digital existence, the promise of ubiquitous truly portable computing has finally been delivered.

Smartphones present a problem though to some people with physical impairments. A touchscreen requires manual dexterity on a scale we able-bodied people take for granted, but remains a useless glass slab to someone unable to use their arms.

LipSync is a project that aims to address the problem of smartphone usage for one such group, quadriplegic people. It’s a mouth-operated joystick for the phone’s on-screen cursor, with sip-and-puff vacuum control for simulating actions such as screen taps and the back button.

To the smartphone itself, the device appears as a standard Bluetooth pointing device, while at its business end the joystick and pressure sensor both interface to a Bluetooth module through an Arduino Micro. The EAGLE board and schematic files are available on the project’s hackaday.io page linked above, and there is a GitHub repository for the code.

Technology is such a part of our lives these days, and it’s great to see projects like this bridge the usability gaps for everyone.  Needless to say, it’s a perfect candidate for the Assistive Technology round of the Hackaday Prize.



Sip-and-Puff Ipod dock highlights assistive technology

Check it out, a Sip-and-Puff Arduino shield. This is an assistive technology that allows the physically challenged to control things using a plastic air tube. Different combinations of sucking (Sip) or blowing (Puff) differentiate between control commands.

In this case the device is used to control an iPod dock, but [Bob Johnson’s] Kickstarter project seeks to put the Sip-and-Puff functionality out there so that it can bridge the control gap no matter what the need. One example that he mentions in the video after the break is a Morse Code keyboard.

This shield uses a pressure sensor to receive input from the plastic tubing. But we’ve also seen it done using mechanical pressure switches. That technique is what was used in the Sip-and-Puff Kayak build.

Continue reading “Sip-and-Puff Ipod dock highlights assistive technology”

Man spends 30 years helping disabled gamers


Using our hands to manipulate game controllers is something most of us take for granted. However for quadriplegics, whose arms and legs are completely paralyzed, gaming becomes a nearly impossible task. One man has spent the last 30 years of his life trying to help quadriplegics once again “pick up” the controller and enjoy a few rounds of their favorite video games.

Retired aerospace engineer [Ken Yankelevitz] has been using his skills to create game controllers that can be easily used by disabled gamers, offering them for sale at cost. Starting with Atari joysticks in 1981, he has been perfecting his craft over the years, creating some 800 mouth-operated game controllers. As the systems and their controllers became more complex, so did [Ken’s] designs. His new Xbox and Playstation controllers use all manner of components, including sip-puff tubes and lip-activated buttons in order to allow users to access every single controller function.

Even as he approaches his 70th birthday, he is busy making controllers, though at a slower pace than he has in the past. He has said that he will continue making them for as long as he can, but at some point he will have to close up shop. This has disabled gamers worried that they may no longer have someone to turn to for custom controllers, though we hope someone steps in to fill the gap whenever that day comes.

Be sure to check out his site to take a look at his designs, what he has done for the disabled community is amazing.

A day at the lake for the disabled

We do a lot of useless hacks just for the fun of it so when we see something with purpose it’s pretty exciting. This hack turns any kayak into a motorized vessel that can be controlled by a quadriplegic person using a sip & puff interface. After the break you can see some clips of navigation and an explanation of the hardware.

[Mark’s] system starts by adding outriggers to a kayak to prevent the possibility of the boat rolling over in the water. Each pontoon has an electric trolling motor attached to it that is controlled by an Arduino via a motor driver.

The Arduino takes navigational commands from a sip & puff controller. A straw in the operator’s mouth allows them to sip or puff for a split second to turn left or right. Longer sips or puffs control forward and reverse incrementally, up to a top speed of about 3.7 miles per hour. [Mark] incorporated an auxiliary remote control interface so that a safety observer can take control of navigation if necessary.

His build came in around $1300, a tiny cost if this makes kayaking available to several people each summer. Great job [Mark]! Continue reading “A day at the lake for the disabled”