Control Android With A Projector And Kinect

If you’re going to build a giant touch screen, why not use an OS that is designed for touch interfaces, like Android? [Colin] had the same idea, so he connected his phone to a projector and a Kinect.

Video is carried from [Colin]’s Galaxy Nexus to the projector via an MHL connection. Getting the Kinect to work was a little more challenging, though. The Kinect is connected to a PC running Simple Kinect Touch. The PC converts the data from the Kinect into TUIO commands that are received using TUIO for Android.

In order for the TUIO commands to be recognized as user input, [Colin] had to compile his own version of Android. It was a lot of work, but using an OS designed for touch interface seems much better than all the other touch screen hacks that start from the ground up.

You can check out [Colin]’s demo after the break. Sadly, there are no Angry Birds.

[youtube=http://www.youtube.com/watch?v=BHB2Fwbf-ck&w=470]

5 thoughts on “Control Android With A Projector And Kinect

  1. MHL, huh? never heard of it before, but it seems like HDMI + charging which is pretty cool.

    Definitely better then mini-HDMI -> HDMI, plus a microUSB to USB for charging. Well ok just 1 less cable but still much easier because you don’t have to worry about where power is in relation to the HDMI port, unless you TV has a USB port on the back of course.(unfortunately mine does not, but my Fios cable box does and that’s the only thing it is good for anyways)

    Too bad you need to compile your own version of Android, otherwise it would be sweet.

    There is no way to fake it out and just “emulate” touch events?

  2. hi, can this be done simply with any touchsreen? I have left questions on android sites with no replies. I want to control my galaxy with my touchscreen in my car. There is a modle now called mimics but its a pain to install. Is there a way to do it with a mirroring app and cables? or another way? Thank You

Leave a Reply to Nicky hCancel reply

Please be kind and respectful to help make the comments section excellent. (Comment Policy)

This site uses Akismet to reduce spam. Learn how your comment data is processed.