Cutting Ribbons with Robots and a Oculus Rift

PR2-GrandOpening

On June 26th, 2014, Clearpath Robotics opened up the doors to their brand new 12,000 square foot robot lair by bringing out a PR2 to cut the ceremonial ribbon and welcome everyone inside. And instead of just programming the ‘locate and destroy’ ribbon sequence, the co-founders opted to use an Oculus Rift to control the robot tearing through the material with flailing arms.

This was accomplished having Jake, the robot, utilize a Kinect 2.0 that fed skeleton tracking data via rosserial_windows, a windows-based set of extension for the Robot Operating System which we heard about in January. The software gathers in a stream of data points each with an X,Y,Z component allowing [Jake] to find himself within a 3D space.Then, the data was collected and published directly into the PR2’s brain. Inject a little python code, and the creature was able to route directions in order to move it’s arms.

Thus, by simply stepping in front of the Kinect 2.0, and putting on the Oculus Rift headset, anyone could teleoperate [Jake] to move around and wave its arms at oncoming ribbons. Once completed, [Jake] would leave the scene, journeying back into the newly created robot lair leaving pieces of nylon and polyester everywhere.

An earlier (un-smoothed) version of the full system can be seen after the break:

A simulated version of the system can also be found in the link posted above.

Comments

  1. Galane says:

    “…tearing through the material with failing arms.” FAILING arms? I think you missed an L in there. ;)

  2. svofski says:

    I would totally trust this robot with a knife and perhaps a scalpel.

    • Andrew says:

      I, for one, welcome our new scissor-wielding robot overlords.

      “Cutting ribbons” or “cutting to ribbons”, this robot is very versatile in the home, or on the battlefield.

  3. trandi says:

    PAINFUL to watch !

  4. el espástico negro says:

    Oh look, it’s remote controlled Roberto from Futurama with Parkinson’s disease! :-/

  5. Luc Roadrunner says:

    Robot is King :-)

  6. Ilia Baranov says:
  7. supershwa says:

    Danger Will Robinson, danger!

  8. DarkStormTrooper says:

    Its an Ozzy Osborne impersonator!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 94,104 other followers