[Jakob Kilian] is working on a glove that he hopes will let the blind “see” their surroundings.
One of the most fascinating examples of the human brain’s plasticity is in its ability to map one sense to another. Some people, for example, report being able to see sound, giving them a supernatural ability to distinguish tones. This effect has also been observed in the visually impaired. There are experiments where grids of electrodes were placed on the tongue or mechanical actuators were placed on the lower back. The signals from a camera were fed into these grids and translated in to shocks or movement. The interesting effect is that the users quickly learned to distinguish objects from this low resolution input. As they continued to use these devices they actually reported seeing the objects as their visual centers took over interpreting this input.
Most of these projects are quite bulky and the usual mess you’d expect from a university laboratory. [Jakob]’s project appears to trend to a much more user-friendly product. A grid of haptics are placed on the back of the user’s hand along with a depth camera. Not only is it somewhat unobtrusive, the back of the hand is very sensitive to touch and the camera is in a prime position to be positioned for a look around the world.
[Jakob] admits that, as an interaction designer, his hardware hacking skills are still growing. To us, the polish and thought that went into this is already quite impressive, so it’s no wonder he’s one of the Hackaday Prize Finalists.
If you have a serious visual impairment, using a computer isn’t easy. [Dhiraj] has a project that allows people fluent in Braille to use that language for input. In addition to having a set position for fingers, the device also reads the key pressed as you type. With some third party software it is possible to even create Word documents, according to [Dhiraj].
You can see the finished product in the video below. This is one of those projects where the idea is the hardest part. Reading six buttons and converting them into characters is fairly simple. Each Braille character uses a cell of six bumps and the buttons mimic those bumps (although laid out for your fingers).
Continue reading “Braille Keyboard Finds Its Voice”
Head-mounted displays range from cumbersome to glass-hole-ish. Smart watches have their niche, but they still take your eyes away from whatever you are doing, like driving. Voice assistants can read to you, but they require a speaker that everyone else in the car has to listen to, or a headset that blocks out important sound. Ignoring incoming messages is out of the question so the answer may be to use a different sense than vision. A joint project between Facebook Inc. and the Massachusetts Institute of Technology have a solution which uses the somatosensory reception of your forearm.
A similar idea came across our desk years ago and seemed promising, but it is hard to sell something that is more difficult than the current technique, even if it is advantageous in the long run. In 2013, a wearer had his or her back covered in vibrator motors, and it acted like the haptic version of a spectrum analyzer. Now, the vibrators have been reduced in number to fit under a sleeve by utilizing patterns. It is being developed for people with hearing or vision impairment but what drivers aren’t impaired while looking at their phones?
Patterns are what really set this version apart. Rather than relaying a discrete note on a finger, or a range of values across the back, the 39 English phenomes are given a unique sequence of vibrations which is enough to encode any word. A
phenome phoneme is the smallest distinct unit of speech. The video below shows how those phonemes are translated to haptic feedback. Hopefully, we can send tweets without using our hands or mouths to upgrade to complete telepathy.
Continue reading “Get Your Tweets Without Looking”
Signing up for college classes can be intimidating, from tuition, textbook requirements, to finding an engaging professor. Imagine signing up online, but you cannot use your monitor. We wager that roughly ninety-nine percent of the hackers reading this article have it displayed on a tablet, phone, or computer monitor. Conversely, “Only one percent of published books is available in Braille,” according to [Kristina Tsvetanova] who has created a hybrid tablet computer with a Braille display next to a touch-screen tablet running Android. The tablet accepts voice commands for launching apps, a feature baked right into Android. The idea came to her after helping a blind classmate sign up for classes.
Details on the mechanism are not clear, but they are calling it smart liquid, so it may be safe to assume hydraulic valves control the raised dots, which they call “tixels”. A rendering of the tablet can be seen below the break. The ability to create a full page of braille cells suggest they have made the technology pretty compact. We have seen Braille written on PCBs, a refreshable display based on vibrator motors, and a nicely sized Braille keyboard that can fit on the back of a mobile phone.
Continue reading “Braille On A Tablet Computer”
Adventure travel can be pretty grueling, what with the exotic locations and potential for disaster that the typical tourist destinations don’t offer. One might find oneself dangling over a cliff for that near-death-experience selfie or ziplining through a rainforest canopy. All this is significantly complicated by being blind, of course, so a tool like this Raspberry Pi low-vision system would be a welcome addition to the nearly-blind adventurer’s well-worn rucksack.
[Dan] has had vision problems since childhood, but one look at his YouTube channel shows that he doesn’t let that slow him down. When [Dan] met [Ben] in Scotland, [Ben] noticed that he was using his smartphone as a vision aid, looking at the display up close and zooming in to get as much detail as possible from his remaining vision. [Ben] thought he could help, so he whipped up a heads-up display from a Raspberry Pi and a Pi Camera. Mounted to a 3D-printed frame holding a 5″ HDMI display and worn from a GoPro head mount, the camera provides enough detail to help [Dan] navigate, as seen in the video below.
The rig is a bit unwieldy right now, but as proof of concept (and proof of friendship), it’s a solid start. We think a slimmer profile design might help, in which case [Ben] might want to look into this Google Glass-like display for a multimeter for inspiration on version 2.0.
Continue reading “The ‘All-Seeing Pi’ Aids Low-Vision Adventurer”
A devastating diagnosis for a young child is every parent’s worst nightmare. All too often there’s nothing that can be done, but occasionally there’s a window of opportunity to make things better for the child, even if we can’t offer a cure. In that case even a simple hack, like a rapid response stairwell light to help deal with night-blindness, can make a real difference.
[Becca] isn’t yet a year old, but she and her parents carry a heavy burden. She was born with Usher Syndrome, an extremely rare genetic disease that affects hearing and vision to different degrees. In [Becca]’s case, she was born profoundly deaf and will likely lose her sight by the time she’s 10 or so. Her dad [Jake] realized that the soon-to-be-toddler was at risk due to a dark stairwell and the night-blindness that accompanies Usher, so he came up with a simple tech solution to the problem.
He chose Philips Hue LED light strips to run up the stringer of the stairs controlled by a Raspberry Pi. Originally he planned to use IFTTT for the job but the latency resulted in the light not switching on fast enough. He ended up using a simple PIR motion sensor which the Pi monitors and then uses the Hue API to control the light. This will no doubt give him a platform for future capabilities to help [Becca].
We’ve covered a few builds where parents have hacked solutions for their kids, like this custom media center for the builder’s autistic son. We suspect [Jake] has a few more tricks up his sleeve to help [Becca], and we’re looking forward to seeing how she does.
What would you do if you suddenly went blind and could never again see the sun set? How would you again experience this often breathtaking phenomenon? One answer is music, orchestrated by the sun and the Weather Warlock.
Built by the musician [Quintron] (builder and inventor of insane electronic instruments), the Weather Warlock is an analog synthesizer controlled by — you guessed it — the weather. It translates temperature, moisture, wind and sunlight into tones and harmonics with an E major root chord. UV, light, moisture, and temperature sensors combined with an anemometer set up outside feed the weather data to a synthesizer that has [Quintron] dialing knobs and toggling switches. The Weather Warlock steams 24/7 to the website weatherfortheblind.org so that the visually impaired are able to tune in and experience the joy of sunrise and sunset through music. Continue reading “The Music Of A Sunset”