Cutting Ribbons with Robots and a Oculus Rift

PR2-GrandOpening

On June 26th, 2014, Clearpath Robotics opened up the doors to their brand new 12,000 square foot robot lair by bringing out a PR2 to cut the ceremonial ribbon and welcome everyone inside. And instead of just programming the ‘locate and destroy’ ribbon sequence, the co-founders opted to use an Oculus Rift to control the robot tearing through the material with flailing arms.

This was accomplished having Jake, the robot, utilize a Kinect 2.0 that fed skeleton tracking data via rosserial_windows, a windows-based set of extension for the Robot Operating System which we heard about in January. The software gathers in a stream of data points each with an X,Y,Z component allowing [Jake] to find himself within a 3D space.Then, the data was collected and published directly into the PR2′s brain. Inject a little python code, and the creature was able to route directions in order to move it’s arms.

Thus, by simply stepping in front of the Kinect 2.0, and putting on the Oculus Rift headset, anyone could teleoperate [Jake] to move around and wave its arms at oncoming ribbons. Once completed, [Jake] would leave the scene, journeying back into the newly created robot lair leaving pieces of nylon and polyester everywhere.

An earlier (un-smoothed) version of the full system can be seen after the break:

Continue reading “Cutting Ribbons with Robots and a Oculus Rift”

Non-Lethal Electric Chair Brings the Death Row Experience Home

Non-Lethal electric chair for Oculus Rift Hackathon

One of our trusty tipsters named [Arman] wrote in to tell us about this awesome little Horror VR Hackathon that sought to create a non-lethal electric chair, for a seriously creepy and shocking experience.

[Arman] works in a small prototyping shop, so when a few guys from the local VR group called to ask for help building a non-lethal electric chair, he thought they were joking — until they showed up at the shop! Finally understanding what they really wanted to do, he hooked them up with an EL wire power supply (high voltage AC, low amperage) for their first prototype.

Unfortunately the EL power supply driver took too much juice, so they called [Arman] back the next day to hack together some of those joke gum shockers instead — he hooked them up to an Arduino and they work like a charm.  Continue reading “Non-Lethal Electric Chair Brings the Death Row Experience Home”

The Crane Game, Oculus Style

crane We’re pretty sure the Hackaday demographic is a a person who sees a giant tower crane lifting beams and girders above a skyline and says, “that would be fun, at least until I have to go to the bathroom.” Realizing the people who own these cranes probably won’t let any regular joe off the street into the cabin, [Thomas] and [screen Name] (see, this is why we have brackets, kids) built their own miniature version with an Oculus Rift.

Instead of a crane that is hundreds of feet tall, the guys are using a much smaller version, just over a meter tall, that is remotely controlled through a computer via a serial connection. Just below the small plastic cab is a board with two wide-angle webcams. The video from these cameras are sent to the Oculus so the operator can see the boom swinging around, and the winch unwinding to pick up small objects.

The guys have also added a little bit of OpenCV to add color based object detection. This is somewhat useful, but there’s also an approximation of the distance to an object, something that would be very useful if you don’t have a three-inch tall spotter on the ground.

Video below.

Continue reading “The Crane Game, Oculus Style”

Third Person Perspective is Guaranteed to Mess With Your Senses

3rd person oculus rift

Third person video games are never really that realistic — you get a much wider range of vision, you can typically see around things your character can’t actually see… the list goes on. But what would it be like to have a third person perspective, in real life?

That’s exactly what some hackers in Poland decided to do! This is their Real World Third Person Perspective VR / AR Experiment. It makes use of an Oculus Rift, two GoPros, a microprocessor and a few servo motors. It’s essentially a glorified camera on a stick that you wear as a backpack, but nonetheless it has a really cool effect.

The project was built in under 2 days to get into the tight deadline for Intel’s Wearable contest, which has an impressive prize list, including a grand prize of $500,000 for business development! They didn’t place, but it’s still a Hack a Day worthy project!

Check it out!

Continue reading “Third Person Perspective is Guaranteed to Mess With Your Senses”

Hackaday Links: June 29, 2014

hackaday-links-chain

Ever see a really cool build on YouTube with no build details at all? Frustrating, right? That’s us with the NES Keytar covering the Game of Thrones theme. He’s using a Raspi with the sound chip in the NES to do live chiptunes. Freakin’ awesome. There’s also the ST:TNG theme as well.

A few years ago the folks at Oculus had an idea – because of cellphones, small, high resolution displays are really cheap, so why not make VR goggles? At Google IO this week someone figured out everyone already has a cellphone, so just wrap it in some cardboard and call it a set of VR goggles. You can get a kit here, but the only difficult to source components are the lenses.

What happens when you put liquid nitrogen under a vacuum? Well, it should evaporate more, get colder, and freeze. Then it breaks up into solid nitrogen snow. No idea what you would do with this, but there ‘ya go. Oh, [NC], we’re going to need a writeup of that LN2 generator.

About a month ago, the House4Hack hackerspace in South Africa told us of their plans to bring a glider down from 20km above the Earth. They finally launched it, The CAA only allowed them to glide back from 6km (20,000 feet), but even from there the foam glider hit 230kph (124 knots). That’s a little impressive for a foam FPV platform, and we’re betting something with a larger wingspan would probably break a spar or something. Shout out to HABEX.

All the electronic dice projects we’ve seen have one thing in common: they’re not cubes. Thus uberdice. It’s six nine-pixel displays on the faces of a cube, powered by a battery, and controlled by an accelerometer. Yes, it is by far the most complicated die ever made, but it does look cool.

Virtual Physical Reality With Kintinuous And An Oculus Rift

oculus

The Kinect has long been able to create realistic 3D models of real, physical spaces. Combining these Kinect-mapped spaces with an Oculus Rift is something brand new entirely.

[Thomas] and his fellow compatriots within the Kintinuous project are modeling an office space with the old XBox 360 Kinect’s RGB+D sensors. then using an Oculus Rift to inhabit that space. They’re not using the internal IMU in the Oculus to position the camera in the virtual space, either: they’re using live depth sensing from the Kinect to feed the Rift screens.

While Kintinuous is very, very good at mapping large-scale spaces, the software itself if locked up behind some copyright concerns the authors and devs don’t have control over. This doesn’t mean the techniques behind Kintinuous are locked up, however: anyone is free to read the papers (here’s one, and another, PDF of course) and re-implement Kintinuous as an open source project. That’s something that would be really cool, and we’d encourage anyone with a bit of experience with point clouds to give it a shot.

Video below.

Continue reading “Virtual Physical Reality With Kintinuous And An Oculus Rift”

Oculus Rift + Head Tracking = The Ultimate Drone Experience

oculus rift quad

What happens when you strap a stereoscopic camera onto a drone and transmit the video feed directly to your Oculus Rift? A pretty amazing experience, that’s what!

Several students from the Norwegian University of Science and Technology recently finished a term project dubbed Oculus FPV. In it, [Erik Hals], [Jacob Prescott], [Mats Svensson], and [Mads Wilthil] succeeded in combining virtual reality, a head mounted display, and a UAV for a great result.

Drones with cameras are the next big step in search and rescue, remote inspection, and many other use cases in other environments that are typically inaccessible for a human to poke around. What we really like about this project is they also mounted the stereoscopic cameras on a gimbal, allowing for full head movement — this means the pilot can “park” (read “hover”) his drone in remote locations, and then look around, without having to worry about performing complex aerial acrobatics to get the right camera angle.

Continue reading “Oculus Rift + Head Tracking = The Ultimate Drone Experience”