The Mother Of All Demos, 50 Years On

If you’re like me, chances are pretty good that you’ve been taught that all the elements of the modern computer user interface — programs running in windows, menus, icons, WYSIWYG editing of text documents, and of course, the venerable computer mouse — descended from the hallowed halls of the Xerox Corporation’s Palo Alto Research Center in the early 1970s. And it’s certainly true that PARC developed these technologies and more, including the laser printer and object-oriented programming, all of which would grace first the workplaces of the world and later the homes of everyday people.

But none of these technologies would have existed without first having been conceived of by a man with a singular vision of computing. Douglas Engelbart pictured a future in which computers were tools to sharpen the human intellectual edge needed to solve the world’s problem, and he set out to invent systems to allow that. Reading a Twitter feed or scanning YouTube comments, one can argue with how well Engelbart’s vision worked out, but there’s no arguing with the fact that he invented almost all the trappings of modern human-computer interaction, and bestowed it upon the world in one massive demonstration that became known as “The Mother of All Demos.”

Continue reading “The Mother Of All Demos, 50 Years On”

This Keyboard And Mouse Also Gives You A Workout

The Ergonomic Handheld Mouse / Keyboard Alternative from [Shervin Emami] is an all-in-one solution for your keyboarding and cursor moving needs.

The core of this build is a ‘grip-strengthening’ device that’s sold to guitarists. While the actual benefit of these devices for guitarists is questionable — there are a few anecdotes any music teacher will tell you about classical pianists ruining their hands with similar devices — the device itself can be converted into a fantastic chording keyboard. All you really need for a full-functioned keyboard is a few buttons in a rugged shell, and this ‘grip strengthener’ has that going in spades.

Underneath the plungers for each button [Shervin] installed a magnet and a magnetic sensor, meaning these buttons are analog, and shouldn’t wear out ever. With just a little bit of code on a Tiny BLE board these analog sensors can become a keyboard, a quadcopter controller, an interface for your VR setup, or anything else that can be controlled with a bunch of buttons.

Not to outdo himself, [Shervin] also managed to add some cursor control functionality to this build. This is done via the IMU onboard the Tiny BLE board, and by all accounts it works great.  You can check out a video of this build pretending it’s both a keyboard and a mouse below.

Continue reading “This Keyboard And Mouse Also Gives You A Workout”

Disassembling Mouse Sensors For Tracking Tongues

We just wrapped up the Human Computer Interface challenge in this year’s Hackaday Prize, and with that comes a bevy of interesting new designs for mice and keyboards that push the envelope of what you think should be possible, using components that seem improbable. One of the best examples of this is The Bit, a project from [oneohm]. It’s a computer mouse, that uses a tiny little trackpad in ways you never thought possible. It’s a mouse that fits on your tongue.

The idea behind The Bit was to create an input device for people with limited use of their extremities. It’s a bit like the Eyedriveomatic, the winner from the 2015 Hackaday Prize, but designed entirely to fit on the tip of your tongue.

The first experiments on a tongue-controlled mouse were done with an optical trackpad/navigation button found on Blackberry Phones. Like all mouse sensors these days, these modules are actually tiny, really crappy cameras. [oneohm] picked up a pair of these modules and found they had completely different internal tracking modules, so the experiment turned to a surface tracking module from PixArt Imaging that’s also used as a filament sensor in the Prusa 3D printer. This module was easily connected to a microcontroller, and with careful application of plastics, was imbedded in a pacifier. Yes, it tracks a tongue and turns that into cursor movements. It’s a tongue-tracking mouse, and it works.

This is an awesome project for the Hackaday Prize. Not only does it bring new tech to a human-computer interface, it’s doing it in a way that’s accessible to all.

Roll Your Own Trackball Mouse

What do you do when you’re into trackball mice, but nothing out there is affordable or meets all your murine needs? You build one, of course. And if you’re like [Dangerously Explosive], who has a bunch of old optical mice squeaking around the shop, you can mix and match them to build the perfect one.

The mouse, which looks frozen mid-transformation into a rodential assassin, is a customized work of utilitarian art. Despite the excellent results, this project was not without its traps. [Dangerously] got really far into the build before discovering the USB interface chip was dead. Then he tried to sculpt a base out of Plasticine and discovered he’d bought the one kind of clay that can’t be baked. After trying his hand at making homemade salt dough, he painstakingly whittled a base from scrap pine using a drill and a hacksaw.

Every bit of this mouse is made from recycled bits, which, if you pair that with the paint job and the chosen shade of blinkenlights, makes this a green mouse on three levels. One of the two parts of this mouse that isn’t literally green, the cord, is still ecologically sound. [Dangerously] wanted a really long tail, so he scavenged a charger cable built for fruity hardware and threaded it through a hollowed-out piece of purple paracord.

We love the thumb-adjacent scroll wheel and the trackball itself, which is a ping pong ball painted black. The cool part is the guide it rolls around in. [Dangerously] spent a long time hand-whittling the perfect size hole in a particularly wide mouse palm rest. All that plastic shaving paid off, because the action is smooth as Velveeta.

[Dangerously] certainly designed this mouse to fit his preferences, and ergonomics seem a bit secondary. For a truly custom fit, try using whatever passes for Floam these days.

Motion-Controlled KVM Switch

Once upon a time, [hardwarecoder] acquired a Gen8 HP microserver that he began to toy around with. It started with ‘trying out’ some visualization before spiraling off the rails and fully setting up FreeBSD with ZFS as a QEMU-KVM virtual machine. While wondering what to do next, he happened to be lamenting how he couldn’t also fit his laptop on his desk, so he built himself a slick, motion-sensing KVM switch to solve his space problem.

At its heart, this device injects DCC code via the I2C pins on his monitors’ VGA cables to swap inputs while a relay ‘replugs’ the keyboard and mouse from the server to the laptop — and vice-versa — at the same time. On the completely custom PCB are a pair of infrared diodes and a receiver that detects Jedi-like hand waves which activate the swap. It’s a little more complex than some methods, but arguably much cooler.

Using an adapter, the pcb plugs into his keyboard, and the monitor data connections and keyboard/mouse output to the laptop and server stream out from there. There is a slight potential issue with cables torquing on the PCB, but with it being so conveniently close, [hardwarecoder] doesn’t need to handle it much.

Continue reading “Motion-Controlled KVM Switch”

Wireless Protocol Reverse Engineered To Create Wrist Wearable Mouse

We’ve seen a few near-future sci-fi films recently where computers respond not just to touchscreen gestures but also to broad commands, like swiping a phone to throw its display onto a large flat panel display. It’s a nice metaphor, and if we’re going to see something like it soon, perhaps this wrist-mounted pointing device will be one way to get there.

The video below shows the finished product in action, with the cursor controlled by arm movements. Finger gestures that are very much like handling a real mouse’s buttons are interpreted as clicks. The wearable has a Nano, an MPU6050 IMU, and a nRF24L01 transceiver, all powered by some coin cells and tucked nicely into a 3D-printed case. To be honest, as cool as [Ronan Gaillard]’s wrist mouse is, the real story here is the reverse engineering he and his classmate did to pull this one off.

The road to the finished product was very interesting and more detail is shared in their final presentation (in French and heavy with memes). Our French is sufficient only to decipher “Le dongle Logitech,” but there are enough packet diagrams supporting into get the gist. They sniffed the packets going between a wireless keyboard and its dongle and figured out how to imitate mouse movements using an NRF24 module. Translating wrist and finger movements to cursor position via the 6-axis IMU involved some fairly fancy math, but it all seems to have worked in the end, and it makes for a very impressive project.

Is sniffing wireless packets in your future? Perhaps this guide to Wireshark and the nRF24L01 will prove useful.

Continue reading “Wireless Protocol Reverse Engineered To Create Wrist Wearable Mouse”

Car as a computer mouse

Turning A Car Into A Computer Mouse

[William Osman] and [Simone Giertz] have graced our pages before, both with weird, wacky and wonderful hacks so it’s no surprise that when they got together they did so to turn Simone’s car into a computer mouse. It’s trickier than you might think.

They started by replacing the lens of an optical mouse with a lens normally used for a security camera. Surprisingly, when mounted to the car’s front bumper it worked! But it wasn’t ideal. The problem lies in that to move a mouse cursor sideways you have to move the mouse sideways. However, cars don’t move sideways, they turn by going in an arc. Move your mouse in an arc right now without giving it any sideways motion and see what happens. The mouse cursor on the screen moves vertically up or down the screen, but not left or right. So how to tell if the car is turning? For that, they added a magnetometer. The mouse then gives the distance the car moved and the magnetometer gives the heading, or angle. With some simple trigonometry, they calculate the car’s coordinates.

The mouse click is done using the car’s horn, but details are vague there.

And yes, using the carmouse is as fun as it sounds, though we still don’t recommend texting while driving using this technique. Watch them in the videos below as they write an email and drive a self-portrait of the car.

Continue reading “Turning A Car Into A Computer Mouse”