Hackaday Prize 2023: Eye-Tracking Wheelchair Interface Is A Big Help

For those with quadriplegia, electric wheelchairs with joystick controls aren’t much help. Typically, sip/puff controllers or eye-tracking solutions are used, but commercial versions can be expensive. [Dhruv Batra] has been experimenting with a DIY eye-tracking solution that can be readily integrated with conventional electric wheelchairs.

The system uses a regular webcam aimed at the user’s face. A Python script uses OpenCV and a homebrewed image segmentation algorithm to analyze the user’s eye position. The system is configured to stop the wheelchair when the user looks forward or up. Looking down commands the chair forward. Glancing left and right steers the chair in the given direction.

The Python script then sends the requisite commands via a TCP connection to an ESP32, which controls a bunch of servos to move the wheelchair’s joystick in the desired manner. This allows retrofitting the device on a wheelchair without having to modify it in an invasive manner.

It’s a neat idea, though it could likely benefit from some further development. A reverse feature would be particularly important, after all. However, it’s a great project that has likely taught [Dhruv] many important lessons about human-machine interfaces, particularly those beyond the ones we use every day. 

This project has a good lineage as well — a similar project, EyeDriveOMatic won the Hackaday prize back in 2015.

Disassembling Mouse Sensors For Tracking Tongues

We just wrapped up the Human Computer Interface challenge in this year’s Hackaday Prize, and with that comes a bevy of interesting new designs for mice and keyboards that push the envelope of what you think should be possible, using components that seem improbable. One of the best examples of this is The Bit, a project from [oneohm]. It’s a computer mouse, that uses a tiny little trackpad in ways you never thought possible. It’s a mouse that fits on your tongue.

The idea behind The Bit was to create an input device for people with limited use of their extremities. It’s a bit like the Eyedriveomatic, the winner from the 2015 Hackaday Prize, but designed entirely to fit on the tip of your tongue.

The first experiments on a tongue-controlled mouse were done with an optical trackpad/navigation button found on Blackberry Phones. Like all mouse sensors these days, these modules are actually tiny, really crappy cameras. [oneohm] picked up a pair of these modules and found they had completely different internal tracking modules, so the experiment turned to a surface tracking module from PixArt Imaging that’s also used as a filament sensor in the Prusa 3D printer. This module was easily connected to a microcontroller, and with careful application of plastics, was imbedded in a pacifier. Yes, it tracks a tongue and turns that into cursor movements. It’s a tongue-tracking mouse, and it works.

This is an awesome project for the Hackaday Prize. Not only does it bring new tech to a human-computer interface, it’s doing it in a way that’s accessible to all.

2018 Hackaday Prize: Build Hope. Design The Future.

Today the 2018 Hackaday Prize begins with a roar. This is our global engineering initiative with huge prizes for those hackers, designers, and engineers who want to use their skill and energy to build something that matters. This year, we challenge you to Build Hope. Show the world the amazing ways technology enriches humanity, and that its benefits can be shared by all.

There is over $200,000 in cash prizes headed to the most interesting hardware builds of the year. With plenty of room for great ideas, the top 100 entries will each receive a $1,000 cash prize and continue the build to final judging. The top five entries will be awarded a $50,000 Grand Prize, and $20,000, $15,000, $10,000, and $5,000 for 2nd through 5th places. We even have some additional seed funding set aside to help early entries to get started.

What is Building Hope?

It feels like there is a steady drumbeat of doom and gloom surrounding technology these days. We hear this foretold in many ways, things like robots rising up to enslave humanity, artificial intelligence and big data being used to manipulate people, and quantum computing on the horizon that will invalidate cryptographic security. Our challenge? Get in there and show the incredible good that technology can do in the world.

Design something that shows the benefits of using knowledge and creativity to solve a problem. Be the shining light that proves our future is full of hope because smart people care about what happens in the world and to the people who live here. It is our responsibility as those who understand powerful technologies to show the best ways they can be used to build up humanity. This is your chance.

Build Hope. Design the Future.

Five Challenges to Choose From

We have five challenge categories to choose from in the 2018 Hackaday Prize. The top twenty entries from each category will receive $1,000 and continue work in order to compete for the top prizes.

2018 Hackaday Prize Challenges

Open Hardware Design Challenge:

This is the challenge you should enter right now. Choose a challenge facing the world today and design the best plan possible for the boldest solution you can envision.

Over the years we’ve seen thousands of Hackaday Prize entries that take on farming, transportation, pollution, safety, scientific research, education, and assistive technologies like custom prosthetics, innovative wheelchairs, and braille interfaces for smartphones. There’s plenty in the world that needs solving and you have the talent to do it!

Robotics Module Challenge:

Build a module that makes it easier to put together advanced robots. Show your designs for the parts that others can build on.

Power Harvesting Challenge:

Build a module that harvests ambient power. Show how we can reduce or remove batteries from more devices.

Human Computer Interface Challenge:

Build an innovative interface for humans to talk to machines or machines to talk to humans. Break down more barriers to make devices more intuitive and natural to use.

Musical Instrument Challenge:

Be creative with this round and build a module, interface, or full instrument that evolves or goes far beyond modern music instrumentation.

Seed Funding For Early Entries

Itching to build something? Get a boost on your material budget by securing a bit of seed funding. Enter your design in the first challenge and pack it with as much information as possible. Each “like” that you get from the Hackaday.io community translates to $1 in seed funding. We have $4000 set aside with a max of $200 per entry. You can follow progress by checking the leaderboard on the Hackaday Prize page.

2018 Hackaday Prize Celebrity Judges

Incredible Judges

The Hackaday Prize has something really special in the judges that volunteer their time and talent to review the 100 finalists. They are accomplished engineers working, researching, and forging ahead to new frontiers in technology. Learn more about the judges on the Hackaday Prize page.

Get Started at World Create Day

This coming Saturday is Hackaday World Create Day, and the perfect time to get started with your Hackaday Prize entry. Stop by a meetup in your area (or host your own) and put your heads together and pick the design challenge you want to work on. We love seeing collaborative entries and this is a great chance to build your engineering dream team.

Five Years of Amazing Engineering

Thousands of entries have been submitted to the Hackaday Prize over the years. Founded in 2014 by Supplyframe CEO Steve Flagg, the Hackaday Prize is now in its fifth year. The challenges change each year, but the goal remains the same: to Build Something That Matters. We are consistently amazed both by the quality of the solutions, and the uncovering of new and interesting problems targeted by the entries.

Studying earth’s oceans is increasingly important be it due to climate change or pollution. Alex Williams was awarded the 2017 Hackaday Prize for his Open Source Underwater Glider, a suite of sensors built into a cleverly low-power underwater autonomous vehicle. In 2016, Alberto Molina took the top spot for DTTO, a modular robotics system made up of multiple single-hinge segments that can reorient themselves. A team working toward an eye-controlled electric wheelchair placed first in 2015 for Eyedriveomatic — a solution that improved life for two of the team members with Motor Neuron Disease, (also called ALS). And the recipients of the first Hackaday Prize were recognized for their team’s development of a network of satellite ground stations (SatNOGS) which anyone can build, add to the network, and share time on to communicate with satellites as they make their orbit. This is an important tool to make low-cost research for things like Cubesats possible, and the network has been growing ever since.

If you feel the need for more inspiration, take a few minutes to look over the Hackaday Prize hall of fame of all of the top finishers through the years.

These are impressive ideas that began with the basic question of how can we do better? A simple idea can change the world but only if you share that idea and work to make it grow. Enter yours in the Hackaday Prize now!

Hackaday Prize Entry: CPAP Humidifier Monitor Alarm

CPAP (Continuous Positive Airway Pressure) machines can be life-changing for people with sleep apnea. [Scott Clandinin] benefits from his CPAP machine and devised a way to improve his quality of life even further with a non-destructive modification to monitor his machine’s humidifier.

With a CPAP machine, all air the wearer breathes is air that has gone through the machine. [Scott]’s CPAP machine has a small water reservoir which is heated to humidify the air before it goes to the wearer. However, depending on conditions the water reservoir may run dry during use, leading to the user waking up dried out and uncomfortable.

To solve this in a non-invasive way that required no modifications to the machine itself, [Scott] created a two-part device. The first part is a platform upon which the CPAP machine rests. A load cell interfaced to an HX711 Load Cell Amplifier allows an Arduino Nano to measure the mass of the CPAP machine plus the integrated water reservoir. By taking regular measurements, the Arduino can detect when the reservoir is about to run dry and sound an alarm. Getting one’s sleep interrupted by an alarm isn’t a pleasant way to wake up, but it’s much more pleasant than waking up dried out and uncomfortable from breathing hot, dry air for a while.

The second part of the device is a simple button interfaced to a hanger for the mask itself. While the mask is hung up, the system is idle. When the mask is removed from the hook, the system takes measurements and goes to work. This makes activation hassle-free, not to mention also avoids spurious alarms while the user removes and fills the water reservoir.

Non-invasive modifications to medical or other health-related devices is common, and a perfect example of nondestructive interfacing is the Eyedriveomatic which won the 2015 Hackaday Prize. Also, the HX711 Load Cell Amplifier has an Arduino library that was used in this bathroom scale refurb project.

Assistive Technology Pioneer Patrick Joyce Has Passed Away

We are once again saddened to report the loss of another great hacker. Patrick Joyce has passed away after a decade-long struggle with ALS/MND. Patrick was the team captain of Eyedriveomatic, the Grand Prize winning hardware from the 2015 Hackaday Prize. The loss of Patrick comes quickly after receiving word on Monday about the death of Patrick’s teammate, Steve Evans.

Despite the challenges Patrick faced in the final years of his life he was a prolific hardware hacker. He and his team won the Hackaday Prize in 2015 for designing a system which allowed electric wheelchairs to be controlled with eye gaze software without altering the chairs themselves (which are often not owned by the user). But he was also a finalist in the Assistive Technologies challenge of the 2016 Hackaday Prize. The Raimi’s Arm project set its goal at creating bionic arms for kids — a noble and worthy challenge for everyone to undertake. Check out Patrick’s profile page and you’ll see he has also built an open source head mouse (an alternative to eye gaze controls) and a headphone robot which allowed him to put on and take off his own headphones.

I find it amazing what he achieved in his work considering the physical limitations placed before him. Patrick had limited use of one hand which he used with a joystick for mouse control. His typing was done using eye gaze. Yet he managed to design and document a number of incredible creations. This is inspiring.

Reflect on this loss to our community, but take comfort in the fact that his work lives on. Cody Barnes, the software developer for the Eyedrivomatic, plans to continue work on the project. If you are interested in helping to make that open source assistive tech available to more people who need it, now is a great time to send a private message to Cody to learn more about getting involved.

Steve Evans Passes Away, Leaves An Inspiring Legacy

It is with great sadness that Hackaday learns of the passing of Steve Evans. He was one of the creators of Eyedrivomatic, the eye-controlled wheelchair project which was awarded the Grand Prize during the 2015 Hackaday Prize.

News of Steve’s passing was shared by his teammate Cody Barnes in a project update on Monday. For more than a decade Steve had been living with Motor Neurone Disease (MND). He slowly lost the function of his body, but his mind remained intact throughout. We are inspired that despite his struggles he chose to spend his time creating a better world. Above you can see him test-driving an Eyedrivomatic prototype which is the blue 3D printed attachment seen on the arm of his chair.

The Eyedrivomatic is a hardware adapter for electric wheelchairs which bridges the physical controls of the chair with the eye-controlled computer used by people living with ALS/MND and in many other situations. The project is Open Hardware and Open Source Software and the team continues to work on making Eyedriveomatic more widely available by continuing to refine the design for ease of fabrication, and has even begun to sell kits so those who cannot build it themselves still have access.

The team will continue with the Eyedrivomatic project. If you are inspired by Steve’s story, now is a great time to look into helping out. Contact Cody Barnes if you would like to contribute to the project. Love and appreciation for Steve and his family may be left as comments on the project log.

Beyond The Prize: Eye Driving Wheelchairs

For this year’s Hackaday Prize, we opened up five challenges for hackers and tinkerers to create the greatest hardware in five categories. We asked citizen scientists to build something to expand the frontiers of knowledge. We asked automation experts to build something more useful than the Internet of chocolate chip cookies. In the Assistive Technologies portion of the prize, we asked our community of engineers to build something that would open the world up to all of us.

While this year’s Assistive Technologies challenge brought out some great projects, there is one project from last year that must be mentioned. The Eyedrivomatic is a project to turn any electric wheelchair into a gaze-controlled robotic wheelchair, opening up the world to a population who has never had this level of accessibility at a price this low.

eyedriveomatic-hardwareThe Eyedrivomatac was the winner of last year’s Hackaday Prize, and given the scope of the project, it’s not hard to see why. The Eyedriveomatic is the solution to the problem of mobility for quadriplegics. It does this surprisingly simply by adding a servo-powered robot onto the joystick of an electric wheelchair, with everything controlled by eye gaze technology. While other systems similar to this exist, it’s the cost of the Eyedrivomatic system that makes it special. The robotic half of the project can be easily manufactured on any 3D printer, all the associated hardware can be bought for just a few dollars, and the software stack is completely open source. The entire system is interchangeable between different models of electric wheelchairs without any modifications, too.

Since winning last year’s Hackaday Prize, Patrick, Steve, and David of the Eyedrivomatic project received the grand prize of $196,883, and are now working towards starting their own production run of their revolutionary device. Right now, there’s a small cottage industry of eye gaze controlled wheelchairs cropping up, and the Eyedrivomatic team is busy building and assembling systems for electric wheelchair users across the globe.

The Eyedrivomatic is the best the Hackaday Prize has to offer. At its heart, it’s an extremely simple device — just a few 3D printed parts, a few servos, an Arduino, and some open source software. The impact the Eyedrivomatic has on its users can’t be understated. It is a liberating technology, one of the greatest projects we’ve seen, and we’ve very proud to have the Eyedrivomatic as a Hackaday Prize champion.

Continue reading “Beyond The Prize: Eye Driving Wheelchairs”