If you’re going to build a giant touch screen, why not use an OS that is designed for touch interfaces, like Android? [Colin] had the same idea, so he connected his phone to a projector and a Kinect.

Video is carried from [Colin]‘s Galaxy Nexus to the projector via an MHL connection. Getting the Kinect to work was a little more challenging, though. The Kinect is connected to a PC running Simple Kinect Touch. The PC converts the data from the Kinect into TUIO commands that are received using TUIO for Android.

In order for the TUIO commands to be recognized as user input, [Colin] had to compile his own version of Android. It was a lot of work, but using an OS designed for touch interface seems much better than all the other touch screen hacks that start from the ground up.

You can check out [Colin]‘s demo after the break. Sadly, there are no Angry Birds.

Even though giant multouch display tables have been around for a few years now we have yet to see them being used in the wild. While the barrier to entry for a Microsoft Surface is very high, one of the biggest problems in implementing a touch table is one of interaction; how exactly should the display interpret multiple commands from multiple users? [Stephan], [Christian], and [Patrick] came up with an interesting solution to sorting out who is touching where by having a computer look at shoes.

The system uses a Kinect mounted on the edge of a table to extract users from the depth images. From there, interaction on the display can be pinned to a specific user based on hand and arm orientation. As an added bonus the computer can also recognize users from their shoes. If a user is wearing a pair of shoes the computer recognizes, they’ll just walk up to the table and the software will recognize them.

Finally [Michelle Annett] can talk about her super secret project she did at Autodesk Research.

Medusa, as [Michelle]‘s project is called, is a Microsoft Surface that has been fitted with 138 proximity sensors. This allows the Surface to sense users walking up to it, and detect users hands and arms above the table top. Multiple users can be detected at the same time, and the left and right hands of two users can be mapped to specific users.

The proximity sensors [Michelle] used are inexpensive, so we’re wondering when someone with a crazy multitouch setup will add proximity sensors to their build. We’d like to play with Medusa, even if just for a virtual game of Settlers of Catan. It seems like the perfect setup…

[Michelle] built Medusa last January during her internship at Autodesk. Now that UIST 2011 is over, she can finally talk about it. There’s also a video demonstrating the possibilities of Medusa, check it out after the break.

Thanks [Fraser] for sending this one in.

When we see artists like Daft Punk or Madeon working their magic in a live setting, we’re always impressed with their controllers. Sample-based artist use controllers like the Monome and Kaoss Pad a lot, but these devices are fairly expensive. Thankfully, we live in an age of multitouch displays, so [Graham Comerford] came up with his own multitouch controller that does just about anything.

The build is based on the Kivy framework and includes a Monome emulator, MIDI drum pads, mixer, and a whole bunch of other sliders and buttons. There’s no word on how [Graham]‘s multitouch display was constructed, but if you’re looking to build your own gigantic audio control setup there’s a lot of info on building Microsoft Surface clones, adapting computer monitors, and spherical multitouch rigs.

We’re not sure if [Graham]‘s virtual drum kit is velocity sensitive but even if it’s not, it’s an interesting bit of kit. Check out an earlier version of his setup after the break.

This is a keyboard alternative that [Sebastian] is building from two Apple Magic Trackpads. The multitouch devices are a good platform for this because they’re designed to pick up several events at the same time. To prototype the locations of the keys he’s using printable transparency sheets. He gives you a sense of where the home row is with a dab of clear fingernail polish that you can feel with your digits.

He may laser etch these pads once the key location is just right. This should give a bit of texture in itself and do away with the need for nail polish but we still like the ingenuity of that solution. The device is being developed in Linux, with some kernel hacking to handle the devices. We asked about source code and [Sebastian] is hesitant to post it because he’s been getting a lot of kernel panics. It sounds like once he cleans things up a bit he’ll share his work.

Don’t forget, there’s an easy hack to do away with the batteries in these things.

We all love a little bit of multitouch, but we’ve seen so many setups that it is getting a bit less exciting. This one will get your attention with its unique shape. It is a spherical multitouch using all open source software. Well, since the poles are unusable, it might just be toroidal, or cylindrical, but it is still impressive. They are using a convex mirror mounted to the upper most point of the frosted sphere to reflect a projector mounted at the bottom of the base. A web cam pointed at that same mirror picks up reflected IR light from a few emitters. You can catch a video of it after the break.

[via boingboing]

[Taichi Inoue] is back again, this time with a multitouch system that uses water as the touch surface.  The setup consists of a tank of water placed atop an LCD, a lamp, and a web cam. The web cam pics up the light that is reflected when something breaks the surface of the water. It is, as far as the computer is concerned, no different than the blob recognition we see with many of the home made multitouch systems. Mixed with his Yukikaze, this guy might end up with the most relaxing computer system in the world.

[via Makezine]

[Daniel] wrote in to show us the project his group has been working on. It is a massive display wall consisting of 28 projectors and 30 computers.  With a resolution of 7168×3072, viewing a 13.3 gigapixel image is a treat. That treat is made even stronger by the fact that navigating the image is done multitouch style with a touchless system built from web cams.  We’ve seen lots of projects come out of the NUI group with similar interfaces, but none that used the webcams like this. Usually, the webcam is detecting some kind of interaction between the person and an infra red light source. Maybe that is happening here and we just don’t see it.

We just found this great portable multitouch rig called the portatouch. Made by a user at the NUI group website named [portatouch], this system uses a stripped down LCD as the display with IR LEDs edge lighting a touch surface in front of it. A camera mounted below the LCD picks up the reflections of the LEDs and converts it to touch points. While the implementation isn’t anything new, the package is really great. If you want to learn how to set up the technical side of it all, head over to the NUI group website and you’ll find all you want. We would love to see a more detailed breakdown of his rig though. The portability and quick construction are fantastic and seem like they could be reproduced without a ton of custom work.

We’re fans of pinch-zooming and that means multitouch. Although the interface is natively supported by both the hardware and operating systems of the Nexus One and Droid phones, it is locked out of the stock installation. You can make multitouch work on both handsets if you’re willing to do a little firmware alteration.

The coding has already been done for you, it’s a matter of loading a custom kernel. Both the Nexus One and the Droid have been rooted, and that’s what you’ll need to do to unlock multitouch with new firmware. In addition to gaining full access to the device OS, you’ll need to load up some different apps that support pinch zooming, etc. Luckily, these are readily available and you may like them better than the stock browser, maps, and photo applications.

The Misa Digital Guitar is a digital music controller like we haven’t seen before. The body, machined out of ABS, looks like a guitar. The player puts theirs hands in the same places you would on a guitar but the lack of strings make it something different.

The left had manipulates inputs in the form of 144 sensors, six in each of the twenty-four fret positions. The right hand doesn’t strum, but uses a multitouch screen to control the inputs. The UI looks solid, something you’ll have to see for yourself after the break. Tieing this all together is an AMD Geode processor running Gentoo Linux. That means this is open source and begging you to make it do your bidding.

[Thanks Zerowizard]

We also ran into a reader of Hack A Day and totally forgot to take his picture. Sorry man, if you run into us again, we’ll get you.

Posted in multitouch hacks, news ]]> http://hackaday.com/2010/01/08/ces-multitouch/feed/ 8 Caleb Kraft http://hackaday.com/2009/12/22/subcycles-multitouch-music-controller/ http://hackaday.com/2009/12/22/subcycles-multitouch-music-controller/#comments Tue, 22 Dec 2009 20:04:21 +0000 Mike Szczys http://hackaday.com/?p=19655 ]]>

Subcycles is a sound controller application that [Christian] is using on the third multitouch display that he built. The screen is a sheet of acrylic in an aluminum frame. The image is rear projected onto an area covered with Digiline dispersion film. As with other projects that use the Community Core Vision package, a PS3 eye camera captures the touch information.

This build does a great job of including the audience in what the musician on stage is doing. [Chris] points out that the sight of artists staring at laptops on stage is becoming more and more common. The ‘Minority Report’-like interface that Subcycles uses makes not just for interesting music, but for an added visual reinforcement to the live part of the performance.

[Thanks Mark]

MIT is debuting their latest advancement in technology, a multitouch screen that also functions as a gestural interface. The multitouch aspect is nothing new, the team explains how traditional interfaces using LEDs or camera systems do work, but fail to recognize gestures off-screen.

Gestures are a relatively recent highlight with the introduction of projects like Natal or perspective tracking, but fail to work at closer distances to the screen. MIT has done what seems the impossible by combining and modifying the two to produce the first ever multitouch close proximity gestural display.

And to think, just a couple of months ago the same school was playing with pop-up books.

[via Engadget]

This looks like a fun little project. [Chris] has built a tank that he is controlling using his iPhone.  Constructed mainly of off the shelf parts, like an Arduino and an Xbee wireless unit, the tank is controlled via processing. You can see that it is fairly responsive as he changes the speed of the motors. You don’t need an iPhone for this, really to do exactly what he’s doing any multi-touch input would work. You can download the code for it from his site.

We’re a bit curious about the solar charging. How much power does this use? Doesn’t that panel look a bit small? How long does it take to charge?

[via HacknMod]