Hackaday Prize 2023: Finger Tracking Via Muscle Sensors

May 12, 2023 by Zoe Skyforest 5 Comments

Whether you want to build a computer interface device, or control a prosthetic hand, having some idea of a user’s finger movements can be useful. The OpenMuscle finger tracking sensor can offer the data you need, and it’s a device you can readily build in your own workshop.

The device consists of a wrist cuff that mounts twelve pressure sensors, arranged radially about the forearm. The pressure sensors are a custom design, using magnets, hall effect senors, and springs to detect the motion of the muscles in the vicinity of the wrist.

We first looked at this project last year, and since then, it’s advanced in leaps and bounds. The basic data from the pressure sensors now feeds into a trained machine learning model, which then predicts the user’s actual finger movements. The long-term goal is to create a device that can control prosthetic hands based on muscle contractions in the forearm. Ideally, this would be super-intuitive to use, requiring a minimum of practice and training for the end user.

It’s great to see machine learning combined with innovative mechanical design to serve a real need. We can’t wait to see where the OpenMuscle project goes next.

Continue reading “Hackaday Prize 2023: Finger Tracking Via Muscle Sensors” →

Jump Like Mario With This Weighted Wearable

May 11, 2023 by Bryan Cockfield 5 Comments

Virtual reality has come a long way in the past decade, with successful commercial offerings for gaming platforms still going strong as well as a number of semi-virtual, or augmented, reality tools that are proving their worth outside of a gaming environment as well. But with all this success they still haven’t quite figured out methods of locomotion that feel natural like walking or running. One research group is leaping to solve one of these issues with JumpMod: a wearable device that enhances the sensation of jumping.

The group, led by [Pedro Lopes] at the University of Chicago, uses a two-kilogram weight worn on the back to help provide the feeling of jumping or falling. By interfacing it with the virtual reality environment, the weight can quickly move up or down its rails when it detects that the wearer is about to commit to an action that it thinks it can enhance. Wearers report feeling like they are jumping much higher, or even smashing into the ground harder. The backpack offers a compact and affordable alternative to the bulky and expensive hardware traditionally used for this purpose.

With builds like these, we would hope the virtual reality worlds that are being created become even more immersive and believable. Of course that means a lot more work into making other methods of movement in the virtual space feel believable (like walking, to start with) but it’s an excellent piece of technology that shows some progress. Augmenting the virtual space doesn’t always need bulky hardware like this, though. Take a “look” at this device which can build a believable virtual reality space using nothing more than a webcam.

Continue reading “Jump Like Mario With This Weighted Wearable” →

Inside A Pair Of Smart Sunglasses

May 6, 2023 by Bryan Cockfield 14 Comments

If you’re willing to spend $200 USD on nothing more than 100 grams of plastic, there are a few trendy sunglasses brands that are ready to take your money before you have time to think twice. Sure, you can get a pair of sunglasses for an order of magnitude less money that do the exact same job, but the real value is in the brand stamped into the plastic and not necessarily the sunglasses themselves. Not so with this pair of Ray-Bans, though. Unlike most of their offerings, these contain a little bit more than a few bits of stylish plastic and [Becky Stern] is here to show us what’s hidden inside.

At first glance, the glasses don’t seem to be anything other than a normal pair of sunglasses, if a bit bulky But on closer inspection they hide a pair of cameras and a few other bits of electronics similar to the Google Glass, but much more subtle. The teardown demonstrates that these are not intended to be user-repairable devices, and might not be repairable at all, as even removing the hinges broke the flexible PCBs behind them. A rotary tool was needed to remove the circuit boards from the ear pieces, and a bench vice to remove the camera modules from the front frame. We can presume these glasses will not be put back together after this process.

Hidden away inside is a pair of cameras, a Snapdragon quad-core processor, capacitive touch sensors, an amplifier for a set of speakers. Mostly this is to support the recording of video and playback of audio, and not any sort of augmented reality system like Google Glass attempted to create. There are some concerning ties with Facebook associated with this product as well which will be a red flag for plenty of us around here, but besides the privacy issues, lack of repairability, and lack of features, we’d describe it as marginally less useful as an entry-level smartwatch. Of course, Google Glass had its own set of privacy-related issues too, which we saw some clever projects solve in unique ways.

Continue reading “Inside A Pair Of Smart Sunglasses” →

NVIDIA Jetson Powers Real-Time Iron Man HUD

May 4, 2023 by Tom Nardi 15 Comments

If you could recreate any of the capabilities of Tony Stark’s Iron Man suit in real life, it would probably be the ability to fly, the super strength, or maybe even the palm-mounted lasers that can cut through whatever obstacle is in your path. But let’s be real, all that stuff is way too hard to try and pull off. Plus you’ll probably just end up accidentally killing yourself in the backyard.

But judging by the videos he’s been posting, [Kris Kersey] is doing one hell of a job creating a functional heads-up display (HUD) similar to the one Tony uses in the films. He’s even building it into a 3D printed Iron Man helmet, with the NVIDIA Jetson board that’s powering the show inside a chest-mounted “Arc Reactor”. He goes into a bit more detail about the project and his goals in an interview recently published on NVIDIA’s own blog. Continue reading “NVIDIA Jetson Powers Real-Time Iron Man HUD” →

Hackaday Prize 2023: Eye Tracking On A Budget

May 2, 2023 by Donald Papp 4 Comments

There is a lot to be learned from the experience of building something functional, and even better if doing so doesn’t break the bank. [Sergej Stoetzer]’s 20€ DIY-Eyetracker aims to be an educational process that covers everything from hardware to functional software in an accessible way.

Hardware based on an economical USB endoscope, and can be used as-is or repackaged with IR illumination.

The eye tracker is based on an economical USB endoscope, which is a small camera optimized for up-close applications. By attaching the camera to a pair of common safety glasses so that it looks at one’s eye, some OpenCV and Python code can do simple tracking and interfacing with other projects.

Basic eye tracking — like determining whether a user is looking up, down, left, or right — can be all that’s needed depending on one’s application. That means that it’s possible to get something working with very little hardware and some easy-to-use OpenCV functions.

Even better performance can be had by adding IR illumination and repackaging the camera into a 3D printed enclosure. The pupil of the eye is an aperture in the iris that appears as a black circle, and that’s even more true under IR illumination which is invisible to the naked eye. If you’re curious about what’s inside those USB endoscope cameras and how to remove their IR filter, there are some good pictures of that process in this project.

The ability to get something prototyped quickly and working well enough to learn new things is a valuable skill, and that’s why re-engineering Education is one of the challenges in the 2023 Hackaday Prize.

Tactile Feedback In VR, No Cumbersome Gloves Or Motors Required

April 26, 2023 by Donald Papp 9 Comments

This clever research from the University of Chicago’s Human Computer Integration Lab demonstrates a fascinating way to let users “feel” objects in VR, without anything getting in the way of using one’s hands and fingers normally. Certainly, the picture here shows hands with a device attached to them, but look closely and you’ll see that it’s on the back of the hand only.

There’s hardware attached to the hands, yes, but only to the backs. Hands and fingers can be used entirely normally while receiving tactile feedback.

The unique device consists of a control box, wires, and some electrodes attached to different spots on the back of the hand and fingers. Carefully modulated electrical signals create tactile sensations on the front, despite originating from electrodes on the back. While this has clear applications for VR, the team thinks the concept could also have applications in rehabilitation, or prosthetics.

Continue reading “Tactile Feedback In VR, No Cumbersome Gloves Or Motors Required” →

An orange m5stickc plus strapped to a wrist in the foreground with the persons other hand pressing down on the top of an installed hat, communicating with another m5stickc plus in the background on the table.

M5StickC Turned Wearable Morse Code Trainer

April 20, 2023 by Abe Connelly 8 Comments

Have you ever felt the options for Morse code communication were too limited? Well, look no further than [marsPRE]’s open source WristMorse communicator that can connect over WiFi, can act as a Bluetooth keyboard or just be used as a Morse Code trainer.

[marsPRE] uses the M5StickC Plus as the base device and attaches a custom “hat” consisting of a 2.5 mm plug for a radio connection and two capacitive touch paddles that act as the Morse Code keyer. The add-on is housed in what looks like a custom 3D print and hangs off of the end of the M5StickC Plus, connecting the hat through an eight 0.1 inch pin header.

Using the M5StickC Plus allows [marsPRE] to focus on the software, providing different options for training, communication and even using the device as a Bluetooth keyboard. The two touch sensors allow for a semi automatic keying, with the top sensor used for long dashes and the bottom sensor used for short dashes.

[marsPRE] took inspiration from the Morserino-32 and has made the wrist morse code trainer open source software and available through GitHub for anyone wanting to take a look. Morse code may an old encoding method but it’s one that’s worthy of respect. You never know when you might need to send a message from your dreams or to translate spoken word Morse code.

Continue reading “M5StickC Turned Wearable Morse Code Trainer” →