DIY Eye Tracking For VR Headsets, From A To Z

August 5, 2023 by Donald Papp 4 Comments

Eye tracking is a useful feature in social virtual reality (VR) spaces because it really enhances presence and communication when one’s avatar has a realistic gaze. Most headsets lack this feature, but EyeTrackVR has a completely open source solution ready for anyone willing to put it together.

Camera is visible in lower right corner.

EyeTrackVR is a combination of hardware, software, and 3D printable mounts for attaching a pair of microcontroller boards, cameras, and IR LEDs to just about any existing VR headset out there. An ESP32-based board and tiny camera module watches each eyeball, and under IR illumination the pupil presents as an easily-identified round black area. Software takes care of turning the camera’s view of the pupil into a gaze direction value that can be plugged into other software.

The project is still under active development, but in its current state is perfectly suitable for creating a functional system that can integrate into a variety of existing headsets with printed mounting brackets. Interested? Check out the intro and if it sounds up your alley, dive into the build guide which spells out everything you need to know. Check out the video below for a demo of EyeTrackVR working in VRChat, along with an overview of software support.

We’ve seen headsets built to custom specs that integrate eye tracking, but even if one is repackaging an existing headset that’s a perfect opportunity to include this feature.

Continue reading “DIY Eye Tracking For VR Headsets, From A To Z” →

Making Your Own VR Headset? Consider This DIY Lens Design

August 1, 2023 by Donald Papp 11 Comments

Lenses are a necessary part of any head-mounted display, but unfortunately, they aren’t always easy to source. Taking them out of an existing headset is one option, but one may wish for a more customized approach, and that’s where [WalkerDev]’s homebrewed “pancake” lenses might come in handy.

Engineering is all about trade-offs, and that’s especially true in VR headset design. Pancake lenses are compact units that rely on polarization to bounce light around internally, resulting in a very compact assembly at the cost of relatively poor light efficiency. That compactness is what [WalkerDev] found attractive, and in the process discovered that stacking two different Fresnel lenses and putting them in a 3D printed housing yielded a very compact pancake-like unit that gave encouraging results.

This project is still in development, and while the original lens assembly is detailed in this build log, there are some potential improvements to be made, so stay tuned if you’re interested in using this design. A DIY headset doesn’t mean you also must DIY the lenses entirely from scratch, and this option seems economical enough to warrant following up.

Want to experiment with mixing and matching optics on your own? Not only has [WalkerDev]’s project shown that off-the-shelf Fresnel lenses can be put to use, it’s in a way good news that phone-based VR is dead. Google shipped over 10 million cardboard headsets and Gear VR sold over 5 million units, which means there are a whole lot of lenses in empty headsets laying around, waiting to be harvested and repurposed.

Beautifully Rebuilding A VR Headset To Add AR Features

July 25, 2023 by Donald Papp 12 Comments

[PyottDesign] recently wrapped up a personal project to create himself a custom AR/VR headset that could function as an AR (augmented reality) platform, and make it easier to develop new applications in a headset that could do everything he needed. He succeeded wonderfully, and published a video showcase of the finished project.

Getting a headset with the features he wanted wasn’t possible by buying off the shelf, so he accomplished his goals with a skillful custom repackaging of a Quest 2 VR headset, integrating a Stereolabs Zed Mini stereo camera (aimed at mixed reality applications) and an Ultraleap IR 170 hand tracking module. These hardware modules have tons of software support and are not very big, but when sticking something onto a human face, every millimeter and gram counts.

Continue reading “Beautifully Rebuilding A VR Headset To Add AR Features” →

Closing In On A PC Enabled PSVR2

July 23, 2023 by Donald Papp 25 Comments

When the PlayStation VR2 headset was released, people wondered whether it would be possible to get the headset to work as a PC VR headset. That would mean being able to plug it into a PC and have it work as a VR headset, instead of it only working on a PS5 as Sony intended.

Enthusiasts were initially skeptical and at times despondent about the prospects, but developer [iVRy]’s efforts recently had a breakthrough. A PC-compatible VR2 is looking more likely to happen.

So far [iVRy] is claiming they have 6 DOF SLAM (Simultaneous Localisation and Mapping), Prox sensor, and stereo camera data.

Most of the juicy bits are paywalled behind [iVRy]’s Patreon. We’re hoping the jailbreak process will eventually be open-sourced.

The PS VR2 headset is quite unlike a PC VR headset in a number of ways, and it has not been historically easy to work with Sony’s products from a reverse-engineering perspective, whether it’s an attempt to improve the user experience of an annoying headset, or an attempt to understand the not-even-remotely-sanely-designed protocols behind the Sony Memory Stick. Getting the PS VR2 headset to work in a way it wasn’t intended was expected to be an uphill battle.

It’s not a finished job, but judging by the progress regularly shared on [iVRy]’s Twitter account, it might only be a matter of time.

Behold A Gallery Of Sony’s PS VR2 Prototypes

July 22, 2023 by Donald Papp 3 Comments

Every finished product stands at the end of a long line of prototypes, and Sony have recently shared an interview and images of their PlayStation VR2 prototypes.

Many of the prototypes focus on a specific functionality, and readers who are not familiar with building things might find it a bit wild to see just how big and ungainly un-optimized hardware can be.

Finished product (bottom) contrasted with functionally-identical prototype (top).

The images are definitely the best part of that link, but the interview has a few interesting bits. For example, one prototype was optimized for evaluating and testing camera placement with a high degree of accuracy, and it hardly looks like a VR headset at all.

The controllers on the other hand seem to have gone though more iterations based on the ergonomics and physical layout of controls. The VR2 controllers integrate the adaptive triggers from the PlayStation 5, which are of a genuinely clever design capable of variable resistance as well as an active force feedback effect that’s not quite like anything that’s come before.

There’s a lot of work that goes into developing something like a VR headset, as we see here and we’ve seen with Facebook’s (now Meta) VR research prototypes. But even when one can leverage pre-made modules as much as possible and doesn’t need to start entirely from scratch, making a VR headset remains a whole heap of work.

Behold A DIY VR Headset Its Creator Will “Never” Build Again

July 10, 2023 by Donald Papp 13 Comments

Unsatisfied with commercial VR headset options, [dragonskyrunner] did what any enterprising hacker would: gathered parts over time and ultimately made their own. Behold the Hades Widebody (HWD), a DIY PC VR headset that aims for a wide field of view and even manages to integrate some face and eye tracking.

The Fresnel elements hugging the primary lenses provide a way of extending the display into the wearer’s peripheral vision.

[dragonskyrunner] is — and we quote — “NEVER building one of these again.” The reason is easily relatable to anyone who has spent a lot of time and effort creating something special: it does the job it was created for, but it also has limitations and is a lot of work. If one were to do it all over again, there would be a host of improvements and changes to consider. But one won’t be doing it all over again any time soon because it’s done now.

The good news is that [dragonskyrunner] made an effort to document things, so there is at least a parts list and enough details for any suitably motivated hacker to replicate the work and perhaps even put their own spin on it.

The Hades Widebody has a dual-lens arrangement and wide displays that aim to provide a wider field of view than most setups allow. There’s a main lens in front of the user’s eyes and a cut Fresnel lens providing a sort of extension to the side. [dragonskyrunner] claims that while there is certainly not a seamless transition between the lens elements, it does a better job than an Ambilight at providing a sense of visuals extending into the wearer’s peripheral vision.

The DIY spirit of making a piece of hardware to suit one’s own needs is exactly the sort of thing that would fit into our 2023 Cyberdeck content, and while a headset by itself isn’t quite enough to qualify (devices must have some form of usable input and output), it just might get those creative juices flowing.

Enhance VR Immersion By Shoehorning An Ambilight Into A Headset

July 9, 2023 by Donald Papp 6 Comments

Everyone wants a wider field of view in their VR headsets, but that’s not an easy nut to crack. [Statonwest] shows there’s a way to get at least some of the immersion benefits with a bit of simple hardware thanks to the VR Ambilight.

Continue reading “Enhance VR Immersion By Shoehorning An Ambilight Into A Headset” →