If you’re going to build a giant touch screen, why not use an OS that is designed for touch interfaces, like Android? [Colin] had the same idea, so he connected his phone to a projector and a Kinect.
Video is carried from [Colin]’s Galaxy Nexus to the projector via an MHL connection. Getting the Kinect to work was a little more challenging, though. The Kinect is connected to a PC running Simple Kinect Touch. The PC converts the data from the Kinect into TUIO commands that are received using TUIO for Android.
In order for the TUIO commands to be recognized as user input, [Colin] had to compile his own version of Android. It was a lot of work, but using an OS designed for touch interface seems much better than all the other touch screen hacks that start from the ground up.
You can check out [Colin]’s demo after the break. Sadly, there are no Angry Birds.
5 thoughts on “Control Android With A Projector And Kinect”
MHL, huh? never heard of it before, but it seems like HDMI + charging which is pretty cool.
Definitely better then mini-HDMI -> HDMI, plus a microUSB to USB for charging. Well ok just 1 less cable but still much easier because you don’t have to worry about where power is in relation to the HDMI port, unless you TV has a USB port on the back of course.(unfortunately mine does not, but my Fios cable box does and that’s the only thing it is good for anyways)
Too bad you need to compile your own version of Android, otherwise it would be sweet.
There is no way to fake it out and just “emulate” touch events?
I was wondering the same wouldnt you just be able to make a custom ime which takes its data from the kinect via the pc?
It seems that synthensizing touch events can be done via adb using the sendevent command-line utility that comes with android, and keyboard input with the input command, and also the monkeyrunner command may be of use, see http://developer.android.com/guide/developing/tools/monkeyrunner_concepts.html ; some googling should be insightful.
hi, can this be done simply with any touchsreen? I have left questions on android sites with no replies. I want to control my galaxy with my touchscreen in my car. There is a modle now called mimics but its a pain to install. Is there a way to do it with a mirroring app and cables? or another way? Thank You
i guess you could if it’s a generic hid(which acts like a mouse) but don’t take my word for it ;)
Please be kind and respectful to help make the comments section excellent. (Comment Policy)