Inputs Of Interest: Ears To Communication For Everyone

February 19, 2020 by Kristina Panos 20 Comments

Welcome back to Inputs of Interest! If you haven’t heard, I am all ears when it comes to new ways of talking to computers and machines. And speaking of ears, did you know they can do useful tricks? If you squeeze your eyes shut tightly and/or yawn widely, you might hear a low-level rumbling sound like distant thunder. A decent percentage of people are able to move theirs voluntarily, but not everyone. Maybe you already knew you could rumble, and have used it to entertain yourself, or dampen the unpleasant sounds of life.

No, you can’t reach your tensor tympani with a Q-tip. Image via Research Gate

That rumbling is caused by a muscle in your middle ear stretching out. It’s called the tensor tympani, and its purpose is to shield your ears from loud sounds like chewing, and oddly enough, thunder. When the tensor tympani are activated, they pull the eardrums taut to keep them from vibrating and getting damaged. Unfortunately, they don’t react quickly enough to protect us from sudden sounds like gunshots.

Nick G is able to rumble on command, and wanted to see if he could somehow use it as an input mechanism that he calls Earswitch. He got a cheap USB otoscope camera and figured out that the tensor tympani’s stretching movement shows up well enough to trigger motion detection software. So far, [Nick] has been able to demonstrate control of a few things, like the Windows on-screen keyboard, Grid3 assistive software, and a head tracking utility.

Continue reading “Inputs Of Interest: Ears To Communication For Everyone” →

Inputs Of Interest: Tongues For Technology

January 21, 2020 by Kristina Panos 23 Comments

Welcome to the first installment of Inputs of Interest. In this column, we’re going to take a look at various input devices and methods, discuss their merits, give their downsides a rundown, and pontificate about the possibilities they present for hackers. I’ll leave it open to the possibility of spotlighting one particular device (because I already have one in mind), but most often the column will focus on input concepts.

A mouth mouse can help you get your input issues licked. Via @merchusey on Unsplash

Some inputs are built for having fun. Some are ultra-specific shortcuts designed to do work. Others are assistive devices for people with low mobility. And many inputs blur the lines between these three ideas. This time on Inputs of Interest, we’re going to chew on the idea of oral inputs — those driven by the user’s tongue, teeth, or both.

Unless you’ve recently bitten it, burned it, or had it pierced, you probably don’t think much about your tongue. But the tongue is a strong, multi-muscled organ that rarely gets tired. It’s connected to the brain by a cranial nerve, and usually remains undamaged in people who are paralyzed from the neck down. This makes it a viable input-driving option for almost everyone, regardless of ability. And yet, tongues and mouths in general seem to be under-utilized as input appendages.

Ideally, any input device should be affordable and/or open source, regardless of the driving appendage. Whether the user is otherwise able-bodied or isn’t, there’s no reason the device shouldn’t be as useful and beautiful as possible.

Continue reading “Inputs Of Interest: Tongues For Technology” →

With ChatGPT, Game NPCs Get A Lot More Interesting

February 8, 2023 by Donald Papp 24 Comments

Not only is AI-driven natural language processing a thing now, but you can even select from a number of different offerings, each optimized for different tasks. It took very little time for [Bloc] to mod a computer game to allow the player to converse naturally with non-player characters (NPCs) by hooking it into ChatGPT, a large language model AI optimized for conversational communication.

If you can look past the painfully-long loading times, even buying grain (7:36) gains a new layer of interactivity.

[Bloc] modified the game Mount & Blade II: Bannerlord to reject traditional dialogue trees and instead accept free-form text inputs, using ChatGPT on the back end to create more natural dialogue interactions with NPCs. This is a refinement of an earlier mod [Bloc] made and shared, so what you see in the video below is quite a bit more than a proof of concept. The NPCs communicate as though they are aware of surrounding events and conditions in the game world, are generally less forthcoming when talking to strangers, and the new system can interact with game mechanics and elements such as money, quests, and hirelings.

Starting around 1:08 into the video, [Bloc] talks to a peasant about some bandits harassing the community, and from there demonstrates hiring some locals and haggling over prices before heading out to deal with the bandits.

The downside is that ChatGPT is currently amazingly popular. As a result, [Bloc]’s mod is stuck using an overloaded service which means some painfully-long load times between each exchange. But if you can look past that, it’s a pretty fascinating demonstration of what’s possible by gluing two systems together with a mod and some clever coding.

Take a few minutes to check out the video, embedded below. And if you’re more of a tabletop gamer? Let us remind you that it might be fun to try replacing your DM with ChatGPT.

Continue reading “With ChatGPT, Game NPCs Get A Lot More Interesting” →

Odd Inputs And Peculiar Peripherals: Chorded Keyset Recreates Engelbart’s Vision

June 26, 2022 by Robin Kearey 7 Comments

Douglas Engelbart’s 1968 “Mother of all Demos” introduced the world to a whole range of technologies we take for granted today, the most prominent being his great invention, the computer mouse. However, the MOAD also showcased things like cut-and-paste text editing, a point-and-click interface, video conferencing, and even online collaboration à la Google Docs. One of the innovations shown that for some reason didn’t stand the test of time was the chorded keyboard: an input device with five keys that can be pressed simultaneously in different combinations, the same way you would play chords on a piano.

While a handful of attempts have been made over the years to bring new life to the “chorder”, it failed to achieve mainstream appeal and remains a curiosity to this day. That makes it a natural fit for the Odd Inputs and Peculiar Peripherals contest, as we can see in [Russ Nelson]’s submission called the Engelbart Keyset, which aims to create a modern 3D printed chorder that works exactly as Engelbart intended it.

It’s important to note that the chorded keyboard was not meant to be just an additional set of five keys. Instead, Engelbart showed the clever interplay between the chorder and the mouse: the five keys under his left hand and the three mouse buttons under his right could be combined to create a full 8-bit input device. [Russ]’s device therefore includes a USB host interface to connect a USB mouse as well as a USB client interface that presents itself as a combination mouse/keyboard device to the PC.

The brains of the device are formed by a Teensy 4.1, which reads out the codes sent by the mouse as well as the five keys on top. If one or more of those keys are pressed together with a mouse button, then a keyboard code is generated corresponding to Engelbart’s original keycode mapping. We’re wondering how practical this whole setup would be in real life; it looks like something you’d have to try hands-on to find out. Fortunately, all the schematics, code and STL files are available on the project page, so with just a bit of work you can have your own MOAD setup on your desk today.

We’ve featured a couple of chorded keyboards on these pages; the Pico Chord, the Chordie and the BAT spring to mind. If you’re looking for a recap of Engelbart’s stunning presentation, check out our piece on the Mother of all Demos, 50 years on.

Getting Root On Linux Amplifier Adds New Inputs

February 3, 2022 by Tom Nardi 26 Comments

We remember when getting Linux on your average desktop computer was a tricky enough endeavor that only those with the most luxurious of graybeards would even attempt it. A “Linux box” in those heady days was more than likely an outdated machine salvaged from the dumpster, side panel forever removed, cranking away in a basement or garage. Fast forward today, and Linux is literally everywhere: from smartphones and luxury cars, to TVs and refrigerators. Ironically it’s still not on most desktop computers, but that’s a discussion for another time.

So when [Michael Nothhard] sent in the fascinating account of how he hacked his Linux-powered Bluesound Powernode N150 amplifier to unlock more inputs, the least surprising element was that there was a “smart amplifier” out there running the free and open source operating system. What piqued our interest was that he was able to bust his way in with relative ease and enable some impressive new capabilities that the manufacturer would probably have rather been kept under wraps.

Configuring the CM6206’s audio settings.

[Michael] explains that the N150 has a USB port on the back side of it, and that officially, it only works with mass storage devices and a handful of approved peripherals such as a Bluetooth dongle. But as he was hoping to connect some more devices to the input-limited amplifier, he wondered if he could get a USB audio adapter recognized by the OS. After using a known exploit to get root access, he started poking around at the underlying Linux system to see what kind of trickery the developers had done.

Based on a fairly common C-Media CM6206 chipset, the StarTech 7.1 USB audio adapter was picked up by the kernel without an issue. But to actually get it working with the amplifier’s stock software, he then needed to add a new <capture> entry to the system’s sovi_info.xml configuration file and make some changes to its default ALSA settings. With the appropriate files modified, the new USB audio input device popped up under the official Bluesound smartphone application.

At the end of the write-up [Michael] notes that you’ll need to jump through a few additional hoops to make sure that an upstream firmware update doesn’t wipe all your hard work. Luckily it sounds like backing up the configuration and returning it to the newly flashed Powernode is easy enough. We’ve certainly seen more elaborate methods of gaining control of one’s sound system over the years.

Reading Inputs From Shift Registers Using Just One Single Pin

November 23, 2011 by Mike Szczys 11 Comments

Here’s an interesting article about reading data from shift registers using less than three pins. 74HC165 shift registers are a popular choice for adding inputs to a microcontroller. They have a parallel input register which can be read using the latch, then shifted into a microcontroller via the data and clock pins. For those counting, that’s the three pins normally associated with driving these devices.

This hack first does away with the latch pin. The addition of a carefully trimmed RC circuit (capacitor is charged by the clock pin, then the resistor lets that cap slowly discharge) means that the device will not latch until after the clock stops toggling. This technique drops the control down to just two pins (data and clock). You can still use hardware SPI to read the data using this method. It’s the same as using SPI to drive 595 shift registers except the microcontroller reads data instead of writing it.

But wait, there’s more! The diagram above actually shows a way of reading this shift register with just one pin. Notice that the clock and data pins are now connected to just one of the microcontroller pins. The data pin has an added resistor, which keeps the current low enough that it will not compete with the clock signal coming from the microcontroller. In between clock pulses, the microcontroller switches from output to input to read the data pin on each cycle. Give it a try, it’s a fun experiment!

Hackaday Podcast 157: Airtag Security, Warped 3D Printing, Suturing Grapes With A DIY Robot Arm, And The Wizard’s Calculator

February 25, 2022 by Tom Nardi No comments

This week Hackaday Editor-in-Chief Elliot Williams and Managing Editor Tom Nardi look at the week’s most interesting stories and projects, starting with the dystopian news that several people have had their bionic eye implants turn off without warning. We then pivot into an only slightly less depressing discussion about the poor security of Apple’s AirTags network and how it can be used to track individuals without their knowledge. But it’s not all doom and gloom. We’ll look at new projects designed to push the envelope of desktop 3D printing, and marvel at a DIY robotic arm build so accurate that it can put stitches in the skin of a grape. You’ll also hear about the surprisingly low cost of homebrew hydrophones, the uncomfortable chemistry behind wintergreen, and an early portable computer that looks like it came from Hogwarts School of Witchcraft and Wizardry.

Take a look at the links below if you want to follow along, and as always, tell us what you think about this episode in the comments!

You wouldn’t Direct Download a Podcast, would you?