I need someone to explain this to me.

Control Android with a projector and Kinect

If you’re going to build a giant touch screen, why not use an OS that is designed for touch interfaces, like Android? [Colin] had the same idea, so he connected his phone to a projector and a Kinect.

Video is carried from [Colin]‘s Galaxy Nexus to the projector via an MHL connection. Getting the Kinect to work was a little more challenging, though. The Kinect is connected to a PC running Simple Kinect Touch. The PC converts the data from the Kinect into TUIO commands that are received using TUIO for Android.

In order for the TUIO commands to be recognized as user input, [Colin] had to compile his own version of Android. It was a lot of work, but using an OS designed for touch interface seems much better than all the other touch screen hacks that start from the ground up.

You can check out [Colin]‘s demo after the break. Sadly, there are no Angry Birds.

Comments

  1. Rob R. says:

    MHL, huh? never heard of it before, but it seems like HDMI + charging which is pretty cool.

    Definitely better then mini-HDMI -> HDMI, plus a microUSB to USB for charging. Well ok just 1 less cable but still much easier because you don’t have to worry about where power is in relation to the HDMI port, unless you TV has a USB port on the back of course.(unfortunately mine does not, but my Fios cable box does and that’s the only thing it is good for anyways)

    Too bad you need to compile your own version of Android, otherwise it would be sweet.

    There is no way to fake it out and just “emulate” touch events?

  2. hhm says:

    It seems that synthensizing touch events can be done via adb using the sendevent command-line utility that comes with android, and keyboard input with the input command, and also the monkeyrunner command may be of use, see http://developer.android.com/guide/developing/tools/monkeyrunner_concepts.html ; some googling should be insightful.

  3. vettekid81 says:

    hi, can this be done simply with any touchsreen? I have left questions on android sites with no replies. I want to control my galaxy with my touchscreen in my car. There is a modle now called mimics but its a pain to install. Is there a way to do it with a mirroring app and cables? or another way? Thank You

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s