Cassapa: Augmented Pool

February 5, 2014 by James Hobson 48 Comments

cassapa_4

No good at pool? Never fear, Cassapa is here! [Alex Porto] has created an augmented reality system for playing pool, and it means almost anyone can make those cool trick shots!

Ca-what? Cassapa (“caçapa”) is a Portuguese word for pool table pocket. The software works by placing a webcam directly above the pool table for image recognition. Dedicated software interprets the image and identifies the position of the holes, borders, balls and the cue which can then be used to calculate game physics. A projector then projects the forecast physics and allows you to make tiny adjustments — updated in real-time — to make the perfect shot.

Unfortunately, having a big projector shining down on your pool table won’t exactly make anyone believe you’re actually good at pool. Although if you could combine this with Google Glass or any other vision augmenting goggles… that would be pretty cool. Well, you’d still be terribly dishonest and a cheater — but anyway, take a look at the video after the break.

Continue reading “Cassapa: Augmented Pool” →

Oculus Rift Goes From Virtual To Augmented Reality

December 9, 2013 by Adam Fabio 19 Comments

[William Steptoe] is a post-doctoral research associate at University College London. This means he gets to play with some really cool hardware. His most recent project is an augmented reality update to the Oculus Rift. This is much more than hacking a pair of cameras on the Rift though. [William] has created an entire AR/VR user interface, complete with dockable web browser screens. He started with a stock Rift, and a room decked out with a professional motion capture system. The Rift was made wireless with the addition of an ASUS Wavi and a laptop battery system. [William] found that the wireless link added no appreciable latency to the Rift. To move into the realm of augmented reality, [William] added a pair of Logitech C310 cameras. The C310 lens’ field of view was a bit narrow for what he needed, so lenses from a Genius WideCam F100 were swapped in. The Logitech cameras were stripped down to the board level, and mounted on 3D printed brackets that clip onto the Rift’s display. Shapelock was added to the mounts to allow the convergence of the cameras to be easily set.

Stereo camera calibration is a difficult and processor intensive process. Add to that multiple tracking systems (both the 6DOF head tracking on the Rift, and the video tracker built-in to the room) and you’ve got quite a difficult computational process. [William] found that he needed to use a Unity shader running on his PC’s graphics card to get the system to operate in real-time. The results are quite stunning. We didn’t have a Rift handy to view the 3D portions of [William’s] video. However, the sense of presence in the room still showed through. Videos like this make us excited for the future of augmented reality applications, with the Rift, the upcoming castAR, and with other systems.

Continue reading “Oculus Rift Goes From Virtual To Augmented Reality” →

Augmented Reality Breadboarding

November 6, 2013 by Adam Fabio 31 Comments

[Scott] sent in this tantalizing view of the what could be the future of bread boarding. His day job is at EquipCodes, where he’s working on augmented reality systems for the industrial sector. Most of EquipCodes augmented reality demos involve large electric motors and power transmission systems. When someone suggested a breadboard demo, [Scott] was able to create a simple 555 led blinker circuit as a proof of concept. The results are stunning. An AR glyph tells the software what circuit it is currently viewing. The software then shows a layout of the circuit. Each component can be selected to bring up further information.

The system also acts as a tutor for first time circuit builders – showing them where each component and wire should go. We couldn’t help but think of our old Radio Shack 150 in 1 circuit kit while watching [Scott] assemble the 555 blinker. A breadboard would be a lot more fun than all those old springs! The “virtual” layout can even be overlayed on real one. Any misplaced components would show up before power is turned on (and the magic smoke escapes).

Now we realize this is just a technology demonstrator. Any circuit to be built would have to exist in the software’s database. Simple editing software like Fritzing could be helpful in this case. We’re also not sure how easy it would be working with a tablet between you and your circuit. A pair of CastAR glasses would definitely come in handy here. Even so, we’re excited by this video and hope that some of this augmented reality technology makes its way into our hands.

Continue reading “Augmented Reality Breadboarding” →

CastAR Goes Live On Kickstarter

October 15, 2013 by Adam Fabio 53 Comments

castar2
[Jeri, Rick and the Technical Illusions crew] have taken the castAR to Kickstarter. We’ve covered castAR a couple of times in the past, but the Kickstarter includes a few new features just ripe for the hacking. First, castAR is no longer confined to a retro-reflective surface. In fact, it’s no longer confined to augmented reality. An optional clip on adapter converts castAR into a “free” augmented reality or a full virtual reality system.

[Jeri] has also posted a video on her YouTube channel detailing the entire saga of castAR’s development (embedded after the jump). The video has a real “heart to heart” feel to it, and is definitely worth watching. The story starts with the early days (and late nights) [Rick] and [Jeri] spent at Valve. She goes through the split with Valve and how the two set up a lab in [Rick’s] living room. [Jeri] also outlines some of the technical aspects of the system. She explains how the optics have been reduced from several pounds of projectors to the mere ounces we see today.

Another surprise addition is the lower level tier rewards of the campaign. The castAR tracking system is offered. The campaign page says the tracking system can be mounted to anything from robots to other VR headsets. The possibilities for hacking are almost endless. We’re curious about setting up our own swarm of quadcopters similar to the UPENN Grasp Lab. The RFID tracking grid is also offered as a separate option. In the gaming system this will be used for tracking tabletop game pieces. Based upon the Kickstarter page, it sounds as if the grid will not only use RFID, but a camera based tracking system. We’re definitely curious what possibilities this will hold.

As of this writing, the castAR Kickstarter campaign is already well past the halfway mark on its way to a $400,000 USD goal.

Continue reading “CastAR Goes Live On Kickstarter” →

Eidos: Audio/Visual Sensory Augmentation

October 10, 2013 by James Hobson 24 Comments

eidos

One of our tipsters led us onto a very cool project by a British university team — It’s called Eidos, and it’s a real-time audio and visual augmentation system.

The creators embarked on this design journey after wondering if there was a way they could control and tune their senses. Imagine Superman and his ability to pick out one voice out of thousand — with this technology, it could be possible.

The clunky white goggles shown in the image above is the concept behind the visual augmentation. It’s akin to long-exposure photography, except that it is in real-time and is fluid video. We’re not sure how this could help anyone, but we have to admit it would be pretty cool to play around with. Maybe if Google Glass ever came out someone could write an app for it to mimic this!

The second device can target your hearing to a specific person in a noisy environment, zoning out all the unnecessary distractions. This could be very helpful for people suffering from attention deficit disorders, although we must imagine it would be very strange to get used to. Can you imagine blocking out everything and only looking at a person’s face and listening to their voice?

Unfortunately there is not much information about the actual tech or software behind these devices or if they even in fact work, but the concept was so interesting we just had to share it. Stick around after the break to see a video explanation and demonstration of the proposed technology.

Continue reading “Eidos: Audio/Visual Sensory Augmentation” →

CastAR Comes To Maker Faire NY 2013

September 24, 2013 by Adam Fabio 12 Comments

castAR-2

If there was one sentence heard over and over at Maker Faire NY, it was “Did you see castAR yet?” The Technical Illusions team was at Maker Faire in full force. [Jeri Ellsworth], [Rick Johnson,] and team brought two demos: the tried and true Jenga simulator, and a newer overhead shooter based on the Unity 3D engine. We didn’t see any earth shattering changes from the previous demos of castAR, as [Jeri] has moved into optimization of the Hardware, and [Rick] toward even more immersive demos of the software. Optimization and preparing for market are considered the “hard yards” of any product design. This is the place where a huge amount of work goes in, but the changes are subtle to the layperson.

In addition to her development of castAR’s ASIC, [Jeri] has been hard at work on the optics. The “old” glasses used a solid plastic optical path. The newer glasses use a hollow path for the twin 720p projectors. This makes them even lighter than the previous generation. Weight on the castAR glasses can’t be overstated. They feel incredibly light. There was no perceptible pressure on the nose or ears when wearing them. Also missing was the motion sickness people often experience with VR. This is because castAR doesn’t replace the user’s vision field, it only augments the vision. Peripheral motion cues are still there, which makes for a much more comfortable experience. Continue reading “CastAR Comes To Maker Faire NY 2013” →

[Jeri] Spills The Beans On Her AR Glasses

May 31, 2013 by Brian Benchoff 52 Comments

In the last year, [Jeri Ellsworth] has been very busy. She was hired by Valve, started development of an augmented reality system, fired by Valve, and started a new company with [Rick Johnson] to bring her augmented reality glasses to the market. On the last Amp Hour podcast she spilled the beans on what went down at Valve, how her glasses work, and what her plans for the future are.

[Jeri] and [Rick]’s castAR glasses aren’t virtual reality glasses like the Oculus Rift or other virtual reality glasses that cut you off from the real world. The castAR glasses preserve your peripheral vision by projecting images and objects onto a gray retro-reflective mat and allows you to interact with a virtual environment with an electronic wand. So far, there are a few demos for the castAR system; a Jenga clone, and a game of battle chess called Team For Chess, a wonderful reference to Valve’s hat simulator.

The electronics inside the castAR glasses are fairly impressive; new frames are drawn on the retro-reflective surface at 100 Hz, positioning accuracy is in the sub-millimeter range, and thanks to [Jeri]’s clever engineering the entire system should be priced at about $200. Not too bad for an awesome device that can be used not only for D&D and Warhammer, but also for some very cool practical applications like visualizing engineering models of 3D prints before they’re printed.