I need someone to explain this to me.

Advanced robotic arm control using Kinect

kinect_teleoperation

[Ryan Lloyd], [Sandeep Dhull], and [Ruben D'Sa] wrote in to share a robotics project they have been keeping busy with lately. The three University of Minnesota students are using a Kinect sensor to remotely control a robotic arm, but it’s not as simple as it sounds.

Using OpenNI alongside PrimeSense, the team started out by doing some simple skeleton tracking before working with their robotic arm. The arm has five degrees of freedom, making the task of controlling it a bit tricky. The robot has quite a few joints to play with, so the trio not only tracks shoulder, elbow, and wrist movements, but they also monitor the status of the user’s hand to actuate the robot’s gripper.

When everything was said and done, the results were pretty impressive as you can see in the video below, but the team definitely sees room for improvement. Using inverse kinematics, they plan on filtering out some of the joint tracking inaccuracies that occur when the shoulders are moved in a certain way. They also plan on using a robotic arm with even more degrees of freedom to see just how well their software can perform.

Be sure to check out their site to see more details and videos.

Comments

  1. wheresTheLink says:

    So… Where is the link to their site?

  2. PocketBrain says:

    Nice proof of concept; perhaps now they can get a grant for a more serious (non-toy) robotic arm. And then… GUNDAM!

  3. tapius says:

    Doesn’t this slightly defeat the purpose of the robotic arm?

  4. Maverick says:

    @tapius … i don’t think so. you can perform tasks in a hazardous environment using a robotic arm, with the operator safe in a far-away room, using such a system!

  5. M@ says:

    Left arm can be used as the gripper/rotate/firin’tehlazer.

    And tapius, isn’t hacking about creating new purposes?

  6. Amos says:

    @taipus: look up “telepresence,” “teleoperation,” or “telerobotics” some time. See also: the Lost in Space movie ;)

  7. Obadiah Stane says:

    Tony Stark was able to build this in a cave

  8. Maverick says:

    @Obadiah Stane … come out of fantasy land kid :)

  9. Ursu Adrian says:

    Here is a little project of my own. A robotic arm ( made by myself ) controlled via a data glove )

  10. Ursu Adrian says:

    sorry, I forgot to post the link : http://www.4shared.com/video/ghSO3QxJ/SAM_1575.html

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s