The Quest 2 wireless VR headsetby Oculus was recently released, and improves on the one-and-a-half year old Quest mainly in terms of computing power and screen resolution. But Oculus is owned by Facebook, a fact that Facebook is increasingly keen on making very clear. The emerging scene is one that looks familiar: a successful hardware device, and a manufacturer that wants to keep users in a walled garden while fully controlling how the device can be used. Oculus started out very differently, but the writing has been on the wall for a while. Rooting and jailbreaking the Quest 2 seems inevitable, but what will happen then? Continue reading “As Facebook Tightens Their Grip On VR, Jailbreaking Looks More Likely”→
We’ve seen homemade VR headsets before, but, often they are dependent on special software or are not really up to par with commercial products. Not so with Relativity, an open source project from [Max Coutte] and [Gabriel Combe]. [Max] says it best:
Relativty is not a consumer product. We made Relativty in my bedroom with a soldering iron and a 3D printer and we expect you to do the same: build it yourself.
Unlike some homebrew gear, Relativity has full Steam VR support. It also has experimental support for positional scaling that tracks your body based on video input.
Virtual reality is usually an isolated individual experience very different from the shared group experience of a movie screen or even a living room TV. But those worlds of entertainment are more closely intertwined than most audiences are aware. Video game engines have been taking a growing role in film and television production behind the scenes, and now they’re stepping out in front of the camera in a big way for making The Mandalorian TV series.
Big in this case is a three-quarters cylindrical LED array 75 ft (23 m) in diameter and 20 ft (6 m) high. But the LEDs covering its walls and ceiling aren’t pointing outwards like some installation for Times Square. This setup, called the Volume, points inward to display background images for camera and crew working within. It’s an immersive LED backdrop and stage environment.
Incorporating projected imagery on stage is a technique going at least as far back as 1933’s King Kong, but it is very limited. Lighting and camera motion has to be very constrained in order to avoid breaking the fragile illusion. More recently, productions have favored green screens replaced with computer imagery in post production. It removed most camera motion and lighting constraints, but costs a lot of money and time. It is also more difficult for actors to perform their roles convincingly against big blank slabs of green. The Volume solves all of those problems by putting computer-generated imagery on set, rendered in real time via video game engine Unreal.
It’s been just over a year since Valve released Index, their flagship VR system, and it’s worth looking back at this GitHub repository as a fine example of how to provide supporting materials to a hacker-friendly hardware design. The image above shows off one of the hacker-friendly design elements: an empty space behind the visor, with a USB port off to the right, that exists for no reason other than to make it easier to mount and plug in whatever one might come up with. There’s more to it than that, however. If one wishes to provide supporting materials for a hardware design, one could certainly do worse than emulate Valve’s example.
The violet 3D model shows the area that modifications can occupy without getting in the way of any sensors.
The hardware repository contains not just CAD models of mod-friendly hardware pieces (both in high-resolution STEP models as well as STL files) but also 3D models of the sensor zones, so modders can ensure they avoid occluding any sensors with their creations. Examples are great, and one provided by Valve is the Booster; a hand controller add-on providing extra comfort for people with large hands or long thumbs. The model also doubles as a reference for designing attachments that will not interfere with any of the tracking or touch-sensitive surfaces of the controllers.
Being hacker-friendly doesn’t mean the hardware has no warranty, but it does mean that there is concrete guidance on what does or doesn’t risk voiding it. In the case of the Index hardware, the guidance is simple: “Anything that requires a T5 or smaller is not user serviceable.”
Valve’s unique multilayer lenses are far thinner than one might expect.
Want to see what exactly is inside the $500 (headset only price) Valve Index VR headset that was released last summer? Take a look at this teardown by [Ilja Zegars]. Not only does [Ilja] pull the device apart, but he identifies each IC and takes care to point out some of the more unique hardware aspects like the fancy diffuser on the displays, and the unique multilayered lenses (which are much thinner than one might expect.)
[Ilja] is no stranger to headset hardware design, and in addition to all the eye candy of high-res photographs, provides some insightful commentary to help make sense of them. The “tracking webs” pulled from the headset are an interesting bit, each is a long run of flexible PCB that connects four tracking sensors for each side of the head-mounted display back to the main PCB. These sensors are basically IR photodiodes, and detect the regular laser sweeps emitted by the base stations of Valve’s lighthouse tracking technology. [Ilja] also gives us a good look at the rod and spring mechanisms seen above that adjust distance between the two screens.
VR headsets are more and more common, but they aren’t perfect devices. That meant [Douglas Lanman] had a choice of problems to address when he joined Facebook Reality Labs several years ago. Right from the start, he perceived an issue no one seemed to be working on: the fact that the closer an object in VR is to one’s face, the less “real” it seems. There are several reasons for this, but the general way it presents is that the closer a virtual object is to the viewer, the more blurred and out of focus it appears to be. [Douglas] talks all about it and related issues in a great presentation from earlier this year (YouTube video) at the Electronic Imaging Symposium that sums up the state of the art for VR display technology while giving a peek at the kind of hard scientific work that goes into identifying and solving new problems.
Early varifocal prototype
[Douglas] chose to address seemingly-minor aspects of how the human eye and brain perceive objects and infer depth, and did so for two reasons: one was that no good solutions existed for it, and the other was that it was important because these cues play a large role in close-range VR interactions. Things within touching or throwing distance are a sweet spot for interactive VR content, and the state of the art wasn’t really delivering what human eyes and brain were expecting to see. This led to years of work on designing and testing varifocal and multi-focal displays which, among other things, were capable of presenting images in a variety of realistic focal planes instead of a single flat one. Not only that, but since the human eye expects things that are not in the correct focal plane to appear blurred (which is itself a depth cue), simulating that accurately was part of things, too.
The entire talk is packed full of interesting details and prototypes. If you have any interest in VR imaging and headset design and have a spare hour, watch it in the video embedded below.
This is a very exciting time for those who like to spend their downtime exploring virtual worlds. The graphics in some big-budget titles are easily approaching photorealism, and immersive multi-channel sound can really make you believe you’ve been transported to another place or time. With another generation or two of GPU development and VR hardware, the line between gaming and reality is bound to get awful blurry.
That said, we’re still a far way off from the holodeck aboard the Enterprise. A high-end PC and the latest in VR can fool your eyes and ears, but that still leaves your other senses out of the fun. That’s why [Jatin Patel] has developed this clever force-feedback mouse using an array of solenoids.
The idea is pretty simple: a Python program on the computer listens for mouse click events, and tells an attached Arduino to fire off the solenoids when the player pulls the virtual trigger. It’s naturally not a perfect system, as it would seem that clicking in the game’s menus would also start your “gun” firing. But as you can see in the video after the break, when it works, it works very well. The moving solenoids don’t just vibrate the mouse around, the metallic clacking actually accentuates the gun sound effects from the game.
With this kind of tactile feedback and an omnidirectional treadmill to keep us moving, we’d be pretty close to fooling our senses into thinking we’re actually somewhere else. Which frankly, sounds quite appealing right about now.
