ROS gains full body telemetry

posted Jan 26th 2011 6:14am by
filed under: Kinect hacks, robots hacks

[Taylor Veldrop] has been playing with an NAO robot and ROS, mixed with a Kinect to get some pretty amazing results. The last time we saw any work done with ROS and the Kinect, it was allowing some basic telemetry using the PR2. [Tyler] has taken this a step further allowing for full body control of the NAO robot. Basic mimicking mixed with a little bit of autonomy allow the NAO to follow his steps around a room and even slice a bananna, or hammer nails. We think this is pretty impressive, especially if he were to mix it together with a motion tracking stereoscopic display. Follow along after the break to see it pull off some of these cool feats.

tagged: , ,


28 Responses to ROS gains full body telemetry

  • jimbob says:
    January 26, 2011 at 6:27 am

    I, for one, welcome our new robot overlords.

    Reply Report comment
  • fartface says:
    January 26, 2011 at 6:33 am

    WEll that barely works.

    Reply Report comment
  • Decepticon says:
    January 26, 2011 at 6:49 am

    I was soooo waiting for the robot to rage and stab his….’master’.

    Otherwise very neat.

    Reply Report comment
  • blkhawk says:
    January 26, 2011 at 6:50 am

    I think the difficulties in picking up a knife might be a “safety feature”.

    Reply Report comment
  • Grovenstien says:
    January 26, 2011 at 7:05 am

    NAO reminds me of observing someone who’s had a massive line of Ketamine!! You now the look, suprise at ones arms and the inability to control them!

    Great to see this little bot having fun!

    Reply Report comment
  • rasz says:
    January 26, 2011 at 7:11 am

    this video.. its like watching a handicapped person do stuff in kitchen :/

    Reply Report comment
  • Colecago says:
    January 26, 2011 at 7:34 am

    People are complaining about accuracy and such should actually play a kinect game, these applications are light years away from how an actual game reads your movements. Try kinect bowling and throw a curve, it doesn’t work so hot.

    Reply Report comment
  • Rob Wentworth says:
    January 26, 2011 at 8:13 am

    Robots with knifes? I wonder how long until virus writers target virtual telepresence robots.

    When your telepresence robot stabs somebody, can you use the same defense as bit torrent users (the neighbor kids must have downloaded those MP3s — it wasn’t me!)?

    Reply Report comment
  • Stevie says:
    January 26, 2011 at 8:33 am

    Absolutely amazing! I really enjoyed watching that. There was laughter, ‘aww’ moments, ‘oh noo’ moments, it was great.

    It’s like watching a child trying to do something. Adorable and really quite impressive. Even more impressive when you consider this is being done by a freelance guy. If he can manage this, imagine what a lab full of people could manage!

    Good guy, good video, good robot.

    Reply Report comment
  • J says:
    January 26, 2011 at 8:44 am

    I’m hoping he’ll feature a Halloween costume for this guy. I vote Chucky…

    Reply Report comment
  • Gdogg says:
    January 26, 2011 at 8:47 am

    A-M-A-Z-I-N-G.

    One step closer to life like in ‘surrogate’.

    Reply Report comment
  • robert says:
    January 26, 2011 at 9:29 am

    @Gdogg
    Wow, some one else watched that movie….lol

    And a agree with most of the wall. Amazing work.

    Its downright creepy at times.

    Reply Report comment
  • mark says:
    January 26, 2011 at 9:49 am

    I love it. The motions seemed pretty smooth and accurate, compared to what I was expecting.

    Who else was reminded of the trailer for the upcoming “Real Steel” http://www.youtube.com/watch?v=ei5l3r1dV4I

    Reply Report comment
  • notmyfault2000 says:
    January 26, 2011 at 10:04 am

    Am I the only one that noticed that due to the way the “eyes” are designed it looks like it’s always looking at the camera? Once I noticed this it got kind of creepy, especially with the knife.

    Reply Report comment
  • james says:
    January 26, 2011 at 12:38 pm

    I love the expression on the robot’s faces as he cuts the banana

    Reply Report comment
  • zool says:
    January 26, 2011 at 1:51 pm

    dude, there are way easier ways to cut a banana

    Reply Report comment
  • X says:
    January 26, 2011 at 1:58 pm

    The first thing I thought when I saw this was Gundam, Evangelion, and Big O could be right around the corner after all.

    Reply Report comment
  • ftorama says:
    January 26, 2011 at 3:19 pm

    Cocorico, this robot is french ^^

    Reply Report comment
  • ftorama says:
    January 26, 2011 at 3:22 pm

    Cocorico, this robot is french ^^

    I follow Nao since the very beginning (even before the first announcement) and I really wait the day when it will be available.

    Reply Report comment
  • eteach says:
    January 26, 2011 at 5:15 pm

    please make this again with another kinetic
    for a head so the operator can view his robotic
    hands with depth, wow in ten years there will be robots with amazing remote capabilities. DANGER WILL ROBINSON DANGER!!…

    Reply Report comment
  • Torwag says:
    January 26, 2011 at 7:05 pm

    Most amazing is for me the fact that all this is just a clever chain of ‘off-the-shelf’ products with some mojo in between.
    No tenthousand dollars dev kits, DSPs and FPGAs… just what Santa brought your kids last Christmas (ok, the robot might stick out).
    Sure lot of room for improvements but its placed on hackaday not on engadet (not that products there would need no improvments)….

    BTW… Tatami mats, sliding doors…. JAPAN!!!

    Reply Report comment
  • Greg says:
    January 26, 2011 at 10:36 pm

    3600 euros is equal to 4933 us dollars.. that’s a bit high to become part of the group of devs..

    albeit the robot seems awesome I just think one could be built at home for less and you wouldn’t have to jump through all the hurdles imposed by the program and none of the commitments either.

    Reply Report comment
  • jaqen says:
    January 27, 2011 at 12:23 am

    @Greg: I’d love to see an article about building a robot like that at home for les money

    Reply Report comment
  • richard says:
    January 27, 2011 at 2:25 am

    **Puts wii motes in robots hand and puts robot in front of kinetic**

    Runs

    Reply Report comment
  • mane says:
    January 27, 2011 at 3:03 am

    Oh cool. Though, seeing this – only a matter of time the little bugger decides (or gets hacked) to cut the owners achilles tendon and stab the guy into the neck.

    One step closer to avatars :)

    Reply Report comment
  • david says:
    January 27, 2011 at 1:02 pm

    this is great!

    Reply Report comment
  • Christina G says:
    January 29, 2011 at 8:06 am

    This is incredible. How long did it take you to create this?

    Reply Report comment
  • Charlotte says:
    February 2, 2011 at 1:15 am

    Go Taylor!
    I believe he’s part of this program: http://www.aldebaran-robotics.com/developer_program

    I think it would be very hard to build your own robot that can do all that, Aldebaran has a 50 people doing R&D on NAO!

    Reply Report comment

    • Leave a Reply

    XHTML: You can use these tags: <a href="" title="" rel=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <pre> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

    Hack a Day serves up fresh hacks each day, every day from around the web as well as hacking related news.

    Send us your hacks






         



    Hacks

    Resources