Kinect hacked to work with Garry’s Mod means endless hours of virtual fun

garrys_mod_kinect

[John B] is a software engineer and had some spare time on his hands, so he started messing around with his Kinect which had been sitting unused for awhile. He wanted to see what he could create if he was able to get Kinect data into a virtual environment that supported real-world physics. The first idea that popped into his head was to interface the Kinect with Garry’s Mod.

If you are not familiar with Garry’s Mod, it is a sandbox environment built on top of Valve’s Source engine. The environment supports real-world physics, but beyond that, it pretty much lets you do or build anything you want. [John] found that there was no good way to get Kinect data into the software, so he built his own.

He used OpenNI to gather skeletal coordinate data from Kinect, which was then passed to some custom code that packages those coordinates inside UDP packets. Those packets are then sent to a custom Lua script that is interpreted by Garry’s Mod.

The result is just plain awesome as you can see in the video below. Instead of simply playing some random game with the Kinect, you get to design the entire experience from the ground up. The project is still in its infancy, but it’s pretty certain that we’ll see some cool stuff in short order. All of the code is available on github, so give it a shot and share your videos with us.

37 thoughts on “Kinect hacked to work with Garry’s Mod means endless hours of virtual fun

  1. Hmm. I’m trying to install OpenNI to play with skeleton tracking — given the video it just looks “ok.” It seems to think his elbows are much higher than they appear in the video.

  2. I agree with Alex
    VG goggles and this = primitive Holodeck
    Just need some way to make your feet hurt when you kick the boxes.

  3. The screenshot made me think that he did a flying kick .. This project may teach kids learning martial Art in the future .. lol

  4. Hmm…kinect…garys mod….plus


    might want it a little bigger in diameter….maybe with some curve to get some wrap at the top?

    on top of one of these….

  5. This, that treadmill.

    Now we just need to cover sensation, somehow. And smell. Hearing and vision we can do any number of ways…but touch and smell? Not so much.

  6. Grr. I love re-writing code for other platforms. I love re-writing code for other platforms. I love re-writing code for other platforms. I love re-writing code for other platforms. I love re-writing code for other platforms.

    Maybe If i say it enough I will like it.

    If I do get it going on 7 I will post in forums k?

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s