Haptic Feedback For FPS Games Relies On OpenCV

March 31, 2021 by Lewin Day 11 Comments

PC gamers consider their platform superior for the sheer processing power that can be brought to bear, as well as the inherent customisability of their rigs. Where they’re let down perhaps is in the typical keyboard and mouse interface, which tends to eschew fancy features such as haptic feedback which have long been standard on consoles. Aiming to rectify this, [Neutrino-1] put together a fancy haptic feedback system for FPS games.

The hack is quite elegant, using a Python app to scrape the GUI of FPS games for a health readout. The health numbers are gleaned using OpenCV to do optical character recognition, and the resulting data is sent to an ESP12E microcontroller over a USB serial connection. The ESP12E then controls a series of Neopixel LEDs and vibration motors, providing color and haptic feedback in response to the user’s health bar changing in game.

Using image recognition allows the system to be quickly reconfigured to work with different games, without the mess of having to learn different APIs for every different title. It’s a really fun way to quickly get a project interfacing with a piece of software that we’d love to see more of in future. It makes a nice complement to other hacks we’ve seen in this space, like the gaming mouse with recoil feedback. Video after the break.

Continue reading “Haptic Feedback For FPS Games Relies On OpenCV” →

Buzzer Does Input And Output

January 25, 2021 by Al Williams 2 Comments

Piezo elements have the useful property of being bidirectional; that is they can move when you apply electricity to them, but they can also generate electricity when you move them. [Carl] takes advantage of this fact to make buttons that can provide haptic feedback. You can see a video of his efforts below the break.

He made two versions of the buttons. One uses a 3D printed housing and the other used a 3D printed spacer in a sandwich configuration. It took a few tries to get it right, as you’ll see. The elements take and produce relatively high voltages, so the bulk of the work was adapting the voltages back and forth. In fact, he even managed to fry his CPU chip with some of the higher voltages involved.

We’d probably look for an easier way to sense the button push, since it seems like a good bit of circuitry just to do that. But the whole circuit provides an input button, haptic feedback, and the option of using the buzzer as a buzzer, so at least it is relatively economical if you need all of those features.

Continue reading “Buzzer Does Input And Output” →

Split Keeb Splits Time Between Desk And Tablet Modes

September 29, 2020 by Kristina Panos 8 Comments

A keyboard you build yourself should really be made just for you, and meet your specific needs. If you approach it this way, you will likely break ground and inspire others simply because it’s personalized. Such is the case with [_GEIST_]’s highly-customized lily58, designed to work in two modes — on the desk, and mounted on the back of a tablet.

The lily58, which is a 58-key split with dual OLED footprints, was just a starting point for this build. For tablet mode, where the keyboard is attached to the back of a tablet with hook-and-loop tape, [_GEIST_] created custom plates that double the thumb keys on the back.

We love that there is a PSP thumbstick for mousing on one layer and inputting keystrokes on other layer. But we can’t decide which is our favorite part: the fact that [_GEIST_] threaded it through the bottom of a Kailh Choc switch, or the fact that there’s a Pimoroni Haptic Buzz with a different wave form for each layer. [_GEIST_] also added an acrylic middle plate layer to support quick-change magnetic tenting legs.

Keyboard mods don’t have to be involved to be adopted by others. This modified Dactyl adds custom wrist rest holders and has deeper bottoms that allow for less than perfect wiring.

Via reddit

A Gaming Mouse With Recoil Feedback

September 8, 2020 by Lewin Day 21 Comments

Rumble first hit the gaming mainstream back in the mid-1990s, and has become de rigeur for console players using gamepads ever since. It’s less prevalent on the PC, because most players rely on keyboards and mice that are rumble-free. However, innovation is possible, and [ilge] put together a modified mouse for shooters that has an excellent recoil feedback device.

The feedback effect is run by an Arduino, which receives serial data from a Python program running on the host computer. When the mouse is clicked, the Python program notifies the Arduino, which then fires a bank of four solenoids repeatedly back-and-forth to generate the feedback effect. The solenoids are triggered by a relay, which is an easy way to switch such a load, though we suspect it may not hold up well over time due to the rapid fire rate and the likelihood of spark damage over time from high inrush current to the solenoids.

It’s a simple build that nonetheless adds a great haptic feedback effect to the otherwise humble computer mouse. While we don’t expect to see pros using the device anytime soon, it’s a great concept that does add to the shooter experience. Similar hardware could likely be put to great use in a VR context, too. The state of the art of haptic technology continues to move at a rapid pace, and we can’t wait to see what comes next. Video after the break.

Continue reading “A Gaming Mouse With Recoil Feedback” →

Hands-Free Haptic Braille Display Is Making Waves

June 7, 2020 by Kristina Panos 9 Comments

In the last few months, most of the world’s population has shied away from touching as many public things as possible. Unfortunately, anyone with low vision who relies on Braille signs, relief maps, and audio jacks doesn’t have this luxury — at least not yet.

A group of researchers at Bayreuth University in Germany are most of the way to solving this problem. They’re developing HaptiRead, a mid-air haptic feedback system that can be used as a touchless, refreshable display for Braille or 3D shapes. HaptiRead is based on a Stratos Explore development kit that has a field of 256 ultrasonic transducers. When a person approaches the display, a Leap motion sensor can detect their hand from up to 2.5 feet away and start providing information via sound waves. Each focus point is modulated with a different frequency to help differentiate between them.

HaptiRead can display information three ways: constant, which imitates static Braille displays, point by point, and row by row. The researchers claim up to 94% accuracy in trials, with the point by point method in the lead. The system is still a work in progress, as it can only do four cells’ worth of dot combination and needs to do six before it’s ready. Check out the brief explainer video after the break, or read the group’s paper [PDF download].

Want to play with refreshable Braille systems? This open-source display uses Flexinol wire to actuate the dots.

Continue reading “Hands-Free Haptic Braille Display Is Making Waves” →

In Pursuit Of Haptics For A Better VR Experience

February 12, 2020 by Mike Szczys 6 Comments

Virtual reality holds the promise of an immersive experience that can satisfy our senses to a level comparable with… well, reality. The field has come a long way, but Sarah Vollmer makes a good point that many of the VR systems currently in use are bulky and difficult to transfer from person to person.

While headsets have become smaller and lighter and now feature improved motion tracking and resolution, their ability to affect the user’s other senses hasn’t seen nearly the same advancement. Haptic feedback systems need to catch up with headsets, and how to unobtrusively allow users feel simulated physical contact in VR is an area Sarah is researching as part of her PhD work. This is the topic of her 2019 Hackaday Superconference talk which you’ll find embedded below.

Continue reading “In Pursuit Of Haptics For A Better VR Experience” →

Haptic Games Bring Fun To The Visually Impaired

November 12, 2019 by Kristina Panos 2 Comments

No matter what your parents might say, games are good for us. They teach us to manage resources and give us dopamine rewards just like eating and mating do. Even if you’re no good at games in general, they are still a fun distraction from life.

There are so many games out there that could be enjoyed by the visually impaired, except that they rely on visuals. For example, you can play Yahtzee with nothing more than five dice, a cup, pencil and paper, and knowledge of the rules and scoring. The biggest obstacles are differentiating the dice from each other and keeping score.

One of our esteemed 2019 Hackaday Prize Top 20 Finalists is [JanThar]’s Haptic Games. [JanThar]’s growing collection of games uses 3D printing, vibration motors, and RFID to replace visual cues with sensory feedback. Yahtzee-wise, there’s a set of printed dice and scorecards. The scorecards use spherical magnets and an abacus layout. [JanThar] is also working on a Memory game to teach Braille, though it could be adapted to pure Braille for the visually impaired. Each game piece contains an RFID chip, so players can hold it up to a reader to check what they have.

Our favorite might be the PONG game that’s built on [JanThar]’s 2017 Hackaday Prize entry, the HaptiVision vest. Through the magic of a 16×8 field of vibration motors, players can track the ball’s movement across their torso and control the paddles with a sliders. There’s a brief demo of the games after the break.

Continue reading “Haptic Games Bring Fun To The Visually Impaired” →