Improving Sports Performance With A Kinect

October 14, 2011 by Brian Benchoff 10 Comments

As a recent Mech E grad, [Alessandro Timmi] knows a lot about moving bodies. His thesis, Virtual Sensei, aims to quantify those movements for better coaching and training in martial arts.

Virtual Sensei uses a Kinect for motion capture during training. From there, the skeleton recorded by the Kinect has a little bit of processing applied and the speed of the fists is calculated. Check out the demo vid for a much better explanation of what Virtual Sensei can do.

Considering the number of sports that require precise alignment of the skeleton and timing of certain movements, we’re thinking this could be the breakout (non-video game) app to get the Kinect into the wild. Golf pros would love to record the swings of their students to make sure their shoulders are aligned.

Most of the Kinect hacks we’ve seen are either robot builds with a few 3D scanners and virtual wardrobes thrown into the mix. Virtual Sensei is a pretty impressive piece of software and with a few additional sports could make a killing.

Check out the freakin awesome animated FAQ and a demo video below.

Continue reading “Improving Sports Performance With A Kinect” →

Hybrid Control Scheme Using An Xbox Game Pad And Kinect

September 7, 2011 by Mike Nathan 16 Comments

hybrid_game_control_using_kinect

The Kinect is an interesting beast. On one hand, it’s fantastic for hacking – a purpose for which it was not designed. On the other hand, it’s “just OK” when it comes to gaming – its entire reason for being.

One of the big complaints regarding the Kinect’s control scheme is that it’s no good for games such as first person shooters, where a large majority of the action involves walking, jumping, and aiming. For his Master’s project, [Alex Poolton] put together a fantastic demonstration showing how the Kinect can be paired with a standard Xbox controller to provide hybrid gaming input.

While you might expect a simple game that shows the fundamentals of the hybrid control system, he has put together a full fledged game demo that shows how this control scheme might be implemented in a real game. [Alex] admits that it’s still a bit rough around the edges, but there’s some real potential in his design.

Continue reading to see a video demonstration of [Alex’s] project in action, and be sure to check out his blog for news and updates on the project.

Continue reading “Hybrid Control Scheme Using An Xbox Game Pad And Kinect” →

Kinect-controlled Delta Robot Has A Magnetic Personality

August 23, 2011 by Mike Nathan 10 Comments

kinect_controlled_delta_robot

[Malte] is a loyal Hackaday reader and neurobiology PhD candidate with a keen interest in hobby robotics – definitely our kind of guy! He wrote in to share a project he has been working on in his spare time, a Kinect-controlled delta robot (Google translation).

Deltares, as it is called, is pretty straightforward as far as delta robots are concerned. It uses three servos to actuate the arms, which are controlled by an AVR micro running BASCOM. The AVR gets its coordinate data from his computer via a serial connection after it has been captured by the Kinect. [Malte] opted to use Microsoft’s official SDK for the project, processing the Kinect skeletal data using a small C# application he wrote.

The end result is pretty neat as you can see in the pair of videos below. In the first video, [Malte] uses Deltares as a plotter, drawing a crude face on a piece of paper with a marker. In the second, he commands Deltares with his right hand, using his left to activate the magnetic solenoid to pick up the steel spheres.

It looks pretty cool to us, and we’d love to see what sorts of things he puts together if he ever ends up making robotics his career rather than a hobby.

Continue reading “Kinect-controlled Delta Robot Has A Magnetic Personality” →

Kinect-based Turntable 3D Scanner Looks Very Promising

August 10, 2011 by Mike Szczys 22 Comments

We know that the appearance of the Kinect 3D camera hardware, and subsequent open source driver hacking conquest, is a game-changer that brings the real world into much closer contact with the virtual world. But it still amazes us when we see a concept like this turntable-based 3D object scanner that works so incredibly well.

The concept is extremely simple. A box made from foamboard rests atop a turntable. At its center is the object you wish to scan being well-lit by a small LED light source at each upper corner of the box. First up some code and capture data about the sides and top of the object as it spins. To put the shoe back together in the virtual world, he used a modified version of RGBDemo v0.6.0, a Kinect focused project written by Nicolas Burrus.

[A.J] says that the scan comes out pretty well after just one pass, but that’s not stopping him from setting his sights on making this work with three of four Kinects at once. Don’t forget to check out his video demonstration which is embedded after the break.

Continue reading “Kinect-based Turntable 3D Scanner Looks Very Promising” →

Quit Monkeying About!

August 9, 2011 by Nick Schulze 16 Comments

This friendly little monkey is the latest creation from [Jan Sieber] and [Ralph Kistler]. Yes it’s another Kinect Hack, the Kinect tracks the users stance using the OpenNI Framework and OSCeleton. The information is sent to an Arduino crammed inside the monkey, also inside the poor little monkey are 10 servo motors and a nightmarish wire skeleton. The monkey is left dangling from the Kinect sensor by several cables, ready to follow your every move. The monkey seems fairly sprightly for someone who has had all their insides removed, it is able to copy a multitude of stances quite swiftly.

The video after the break shows the monkey in action for about 1 minute. Then the team go through the build and application of the clever little monkey in a musical/documentary style video. There is also a creepy section where the monkey draws its own skeleton then freaks out.. Enjoy..

Continue reading “Quit Monkeying About!” →

Programming The Kinect To Work With Android

August 8, 2011 by Jeremy Cook 7 Comments

The Kinect has been hacked for many purposes, but this Android implementation tutorial is the first we’ve heard of it being used on a mobile phone platform. Although not a finished product at this point, [Raymond’s] tutorial is a good starting point for those wanting to experiment with fusing these two technologies.

The Kinect programming for this tutorial has been done with the Tegra Ventana development kit for Android 3.0. An Ubuntu-Linux installation is used, but this technique should be portable to any Linux system according to the author.

The procedure given is pretty straightforward, and the author even provides an example of the results in a video after the break. It’s interesting to note that, when connected, the Kinect is seen as two devices, “Xbox NUI Camera” and “Xbox NUI audio”. We look forward to new hacks to come out for this device, possibly using this set of tools. Continue reading “Programming The Kinect To Work With Android” →

Play Dress Up With Kinect

July 7, 2011 by Mike Nathan 20 Comments

kinect_virtual_dressing_room

While we have seen Kinect-based virtual dressing rooms before, the team at Arbuzz is taking a slightly different approach (Translation) to the digital dress up game. Rather than using flat images of clothes superimposed on the subject’s body, their solution uses full 3D models of the clothing to achieve the desired effect. This method allows them to create a more true to life experience, where the clothing follows the subject around, flowing naturally with the user’s movements.

Like many other Kinect hacks, they use openNI and NITE to obtain skeletal data from the sensor. The application itself was written in C# with Microsoft’s XNA game development tools, and uses a special physics engine to render the simulated cloth in a realistic fashion

[Lukasz] says that the system is still in its infancy, and will require plenty of work before they are completely happy with the results. From where we’re sitting, the demo video embedded below is pretty neat, even if it is a bit rough around the edges. We were particularly pleased to see the Xbox’s native Kinect interface put to work in a DIY project, and we are quite interested to see how things look once they put the final touches on it.

Continue reading “Play Dress Up With Kinect” →