Charlotte, the hexapod with 3D vision

spider

Charlotte’s chassis comes from as a kit, but the stock electronics are based on an Arduino – not something for a robot that needs to run computer vision apps. [Kevin] ended up using a Raspi for the controller and gave Charlotte eyes with an Asus XTION. Edit: or a PrimeSense sensor These sensors are structured light depth cameras just like the kinect, only about smaller, lighter, and have a better color output.

Hardware is only one half of the equation, so [Kevin] tossed the Arduino-based stock electronics and replaced them with a Raspberry Pi. This allowed him to hone his C++ skills and add one very cool peripheral – the XTION depth camera.

To the surprise of many, we’re sure, [Kevin] is running OpenNI¬†on his Raspberry Pi, allowing Charlotte to take readings from her depth camera and keep from colliding into any objects. The Raspberry Pi is overclocked, of course, and the CPU usage is hovering around 90%, but if you’re looking for a project that uses a depth sensor with a Pi, there you go.

17 thoughts on “Charlotte, the hexapod with 3D vision

  1. Impressive work! Just speculating here, but I figure if the rapsi doesn’t cut it, it could be ditched in favor of one of those dual/quad-core, ARM powered pc-on-a-stick for some more horsepower (and connectivity). Besides, four ARMs makes for a better balance with the six legs… :D

      1. the real price of the servos is that they have fancy built-in sensors. if you take a servo, slap on some sensor and make a nice case for it, you could have the same thing.

        1. That’s not true. Primesense is the developer of the entire technology package used here. They pair the projected pattern with the camera and their own custom hardware on a chip behind the IR camera. In fact it is Primesense who is the Brains behind the kinect, holding Microsoft’s hand the entire way. Primesense licenses the technology to Microsoft and Asus, who are third party venders of Primesense sensors. They also hold all of the patents.

  2. No it’s an Xtion Pro Live. I can vouch for it. :) There is very little difference between the two. The only exception is it says Xtion on the base which I took off to mount it to the servo bracket.
    Thank you for the write up Brian!

  3. Very nice! I’ve been saving for the AX18 version of that same chassis for a while now with a very similar project in mind. The only real difference in what I had planned was to use a PCDuino instead of the Raspi. Anyway, very nice work. I hope to proceed with my similar project in June when I get my bonus.

    1. The above kit is the AX-18 version. AX-18’s speed is amazing though in the above video I didn’t showcase that. That PCDuino looks great! I shop at sparkfun all the time and have never noticed that product.

  4. Nice work. I’m gonna use the Raspberry Pi as 3D Scanner on a Quadcopter and would like to know how much CPU and RAM your Raspberry has needed for your Project.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s