In the last year, [Jeri Ellsworth] has been very busy. She was hired by Valve, started development of an augmented reality system, fired by Valve, and started a new company with [Rick Johnson] to bring her augmented reality glasses to the market. On the last Amp Hour podcast she spilled the beans on what went down at Valve, how her glasses work, and what her plans for the future are.
[Jeri] and [Rick]’s castAR glasses aren’t virtual reality glasses like the Oculus Rift or other virtual reality glasses that cut you off from the real world. The castAR glasses preserve your peripheral vision by projecting images and objects onto a gray retro-reflective mat and allows you to interact with a virtual environment with an electronic wand. So far, there are a few demos for the castAR system; a Jenga clone, and a game of battle chess called Team For Chess, a wonderful reference to Valve’s hat simulator.
The electronics inside the castAR glasses are fairly impressive; new frames are drawn on the retro-reflective surface at 100 Hz, positioning accuracy is in the sub-millimeter range, and thanks to [Jeri]’s clever engineering the entire system should be priced at about $200. Not too bad for an awesome device that can be used not only for D&D and Warhammer, but also for some very cool practical applications like visualizing engineering models of 3D prints before they’re printed.
Here’s an interesting take on using augmented reality alongside hobby electronics. The project, which comes from a group of researchers at the MIT Media Laboratory, starts off by making simple electronic devices like a radio with two knobs using network connected hardware. In other words, build something using an Arduino and include a way to get it on a network. With the radio example on knob is for tuning, the other adjusts the volume. But pick up an iPad and aim its camera at the device — which is what the image above is showing — and those knobs will get a lot more functionality. This opens up a whole set of virtual controls that can be assigned to different segments of the knob controllers.
This is certainly a better use of augmented reality than using it in advertisements which is where it usually shows up. We also think that the proliferation of personal electronics that include high-quality camera modules makes wide adoption a lot more plausible than some of the projector-based augmented reality we’ve seen. Check out a full demo in the video after the break and if that leaves you hungry for details you can get your hands on the whitepaper (PDF).
Continue reading “Hobby electronics team up with augmented reality”
We see a lot of video game tech coming out of the three console giants (Microsoft, Sony, and Nintendo). With one look we can usually predict what is going to be a flop. Case and point is the Wii U whose sales have been less than extraordinary and Sony Move which is motion control directed as hardcore games who we believe are perfectly happy with the current evolution of their dual shock controllers. But this time around we think Microsoft has it nailed. They’re showing off technology they call IllumiRoom which uses a projector to bring your entire gaming room into the experience.
The image above is not doctored. This is a picture of IllumiRoom in action. A projector on the coffee table automatically calibrates to the room (using Kinect 3D data for mapping) in order to show realistic graphic rendering on the non-flat projection surfaces. In our mind, this comes straight out of Kinect hacking projects like the Hadouken projector. With this in place, the game designers are given free rein to come up with all kinds of different ways to use the feature. Stick with us after the break to see what they’ve developed.
Continue reading “Microsoft IllumiRoom breaks your video game out of its television prison”
For a final design project, [Frank] and his group took on an augmented reality project. The goal was to make objects interactively controllable by pointing a smartphone at them. Their solution was Augmented Reality Universal Controller and Identifier (ARUCI).
The system locates controllable objects by sensing IR beacons that contain identifiers for each object. The IR is received by a Wiimote sensor, which has been integrated into a custom PCB. This board sits in a 3D printed enclosure, and mounts to the back of a smartphone. The electronics are powered by tapping off of the phone’s battery.
Commands are sent to devices using a custom 2.4 GHz protocol which was implemented using the ATmega128RFA1. Each device has another ATmega to receive the signal and control the real world object. In their demo, the group shows the system controlling devices including a TV, a radio, and an RC car.
The system provides an interesting way to interact with objects, and the hardware integration is quite impressive. After the break, watch [Frank] give a demo.
Continue reading “IR Based Augmented Reality”
Over Thanksgiving, [Greg] had a little time on his hands and decided he needed an afternoon project. Having a few bits of plywood, an xacto knife, and some blue paint on hand meant a miniature TARDIS would take shape on his workbench. After finishing the model, [Greg] continued improving it with a blinky LED when the thought of adding an interior to the TARDIS entered his mind. An idea too good to pass up, really.
The TARDIS, of course, is smaller on the outside, so [Greg] needed a way to virtually model the interior of  and ’s home. After playing around with Blender for a few days, [Greg] had a reasonable 3D facsimile of the TARDIS interior. Now the only problem was to display it behind the front door.
[Greg] whipped up a small app for his phone that reads a zebra print pattern behind the door and overlays the 3D modeled TARDIS interior. Yes, it’s only viewable through augmented reality, but tilting the desktop TARDIS from side to side makes the entire console room visible. You can check out [Greg]’s TARDIS interior in the video after the break.
Continue reading “Making a TARDIS bigger on the inside”
[Kevin Mellott’s] take on the VFX1 was to update it so it can be used with modern computers requiring just a USB socket and VGA feed.
The VFX1 is a Virtual Reality Headset that hit the market in the first half of the 90’s. The headset was the first of its kind to hit the home market and was ahead of its time. The VFX1 was developed and marketed by Forte Technologies, who’s assets where purchased in 1997 by Vuzix who now produce modern day Video glasses with optional tracking system.
What [Kevin] has achieved is nothing more than remarkable. The original system required a massive ISA card and a link from this card to the Feature Connector on the display card. [Kevin] did away with the ISA card and FCON replacing it with what he calls the LinkBox. This LinkBox has serial or USB out and accepts stereo/mono VGA input or RGB.
The system can now be used with modern day computers including laptops. Those into VR should really check this out.
Continue reading “VFX1 Virtual Reality Headset LinkBox”
There are so many good ideas crammed into this project its hard for us to believe this isn’t already widely used for critical welding applications. Traditional welding masks simply filter out light to protect the welder’s eyes. This mask doesn’t have a window in it at all. Instead, the mask includes two cameras on the outside and two LCD screens on the inside. It filters light by processing the video which lends itself to that grab-bag of features we mentioned earlier.
Possibly the best of the system is its ability to selectively filter the brightness of the weld. What this means is that areas outside of the welding arc appear at a normal brightness level, whereas before they would have been greatly dimmed. A demonstration of augmented reality is also shown, where a computer monitors the welding surface, giving the welder a target to follow and measuring the distance between the weld and the filament. The video mentions that an FPGA would be well suited for the image processing, making us think this could be produced at a reasonable cost. After all, they already use X-ray machines for some welds, we’d bet a set of these helmets could be supplied to a crew at a similar cost.