TAKTO, Open Source Hand-Tracking Built Like LEGO

October 16, 2026 by Ian Bos 8 Comments

Hand tracking in VR/AR can add a substantial amount of immersion and added interactivity. Unfortunately, most camera based tracking suffers when fingers get covered, intertwined, or simply out of view of the headset’s camera. What’s even less common are methods of giving feedback to the user’s hands. [Sebastian Molano] saw these issues and decided if anyone was going to make an open-source solution, it was going to be him with his thesis on TAKTO.

Clear visuals show step-by-step assembly.

TAKTO aims to remove the prior issues mentioned with visual tracking by using magnetic encoders to tell where the device is and the finger’s position inside it. Actuators are able to pull on the fingers themselves to add even further information to the user. Of course, none of this is too crazy, as we have seen similar projects before. Where TAKTO stands out is the extent of the support outside of a one-off hand tracker.

TAKTO.one not only holds general information about the project itself, but also an entire digital twin of the live device. This console can give you a visual of using the glove and general status information. Documentation on how to assemble one for yourself is presented in clean visuals, which should make the build process painless.

Everything else about how to make the hand for yourself can be found on the project’s GitHub. The price tag is steep for the actuated version, though there is a sensing-only version for hand tracking, and most of the cost comes from the quality actuators used. If you want to look into implementing some usability into existing VR hardware, make sure to look at what Valve has released publicly!

Haptic Soft Buttons Speak(er) To Your Sense Of Touch

April 24, 2025 by Tyler August 7 Comments

There’s just something about a satisfying “click” that our world of touchscreens misses out on; the only thing that might be better than a good solid “click” when you hit a button is if device could “click” back in confirmation. [Craig Shultz] and his crew of fine researchers at the Interactive Display Lab at the University of Illinois seem to agree, because they have come up with an ingenious hack to provide haptic feedback using readily-available parts.

The “hapticoil”, as they call it, has a simple microspeaker at its heart. We didn’t expect a tiny tweeter to have the oomph to produce haptic feedback, and on its own it doesn’t, as finger pressure stops the vibrations easily. The secret behind the hapticoil is to couple the speaker hydraulically to a silicone membrane. In other words, stick the thing in some water, and let that handle the pressure from a smaller soft button on the silicone membrane. That button can be virtually any shape, as seen here.

Aside from the somewhat sophisticated electronics that allow the speaker coil to be both button and actuator (by measuring inductance changes when pressure is applied, while simultaneously driven as a speaker), there’s nothing here a hacker couldn’t very easily replicate: a microspeaker, a 3D printed enclosure, and a silicone membrane that serves as the face of the haptic “soft button”. That’s not to say we aren’t given enough info replicate the electronics; the researchers are kind enough to provide a circuit diagram in figure eight of their paper.

In the video below, you can see a finger-mounted version used to let a user feel pressing a button in virtual reality, which raises some intriguing possibilities. The technology is also demonstrated on a pen stylus and a remote control.

This isn’t the first time we’ve featured hydraulic haptics — [Craig] was also involved with an electroosmotic screen we covered previously, as well as a glove that used the same trick. This new microspeaker technique does seem much more accessible to the hacker set, however.

Continue reading “Haptic Soft Buttons Speak(er) To Your Sense Of Touch” →

Being Hit In The Virtual World

November 17, 2015 by James Hobson 9 Comments

Virtual reality could be the next big thing in the gaming world. And while VR displays and headsets are getting more and more sophisticated, many are forgetting perhaps the biggest feature VR will need to succeed — haptic feedback. [Pedro Lopes], [Alexandra Ion] and [Prof. Patric Baudisch] from the Hasso Plattner Institute is hoping to change that, with a project called Impacto: Simulating Physical Impact by Combining Tactile with Electrical Muscle Stimulation.

We’ve covered lots of haptic feedback devices over the past few years — some use mini gyros to simulate resistance, others blow air on you, but this is the first time we’ve seen one that combines muscle stimulation to really cause a physical effect.

They’re using an Oculus rift, and a Microsoft Kinect to perform the research. For their demonstration they use a basic boxing game that allows the user to feel the computer’s punches — but don’t worry, it doesn’t hit that hard!

Continue reading “Being Hit In The Virtual World” →