DIY Eye Tracking For VR Headsets, From A To Z

Eye tracking is a useful feature in social virtual reality (VR) spaces because it really enhances presence and communication when one’s avatar has a realistic gaze. Most headsets lack this feature, but EyeTrackVR has a completely open source solution ready for anyone willing to put it together.

Camera is visible in lower right corner.

EyeTrackVR is a combination of hardware, software, and 3D printable mounts for attaching a pair of microcontroller boards, cameras, and IR LEDs to just about any existing VR headset out there. An ESP32-based board and tiny camera module watches each eyeball, and under IR illumination the pupil presents as an easily-identified round black area. Software takes care of turning the camera’s view of the pupil into a gaze direction value that can be plugged into other software.

The project is still under active development, but in its current state is perfectly suitable for creating a functional system that can integrate into a variety of existing headsets with printed mounting brackets. Interested? Check out the intro and if it sounds up your alley, dive into the build guide which spells out everything you need to know. Check out the video below for a demo of EyeTrackVR working in VRChat, along with an overview of software support.

We’ve seen headsets built to custom specs that integrate eye tracking, but even if one is repackaging an existing headset that’s a perfect opportunity to include this feature.

Continue reading “DIY Eye Tracking For VR Headsets, From A To Z”

Making Your Own VR Headset? Consider This DIY Lens Design

Lenses are a necessary part of any head-mounted display, but unfortunately, they aren’t always easy to source. Taking them out of an existing headset is one option, but one may wish for a more customized approach, and that’s where [WalkerDev]’s homebrewed “pancake” lenses might come in handy.

Engineering is all about trade-offs, and that’s especially true in VR headset design. Pancake lenses are compact units that rely on polarization to bounce light around internally, resulting in a very compact assembly at the cost of relatively poor light efficiency. That compactness is what [WalkerDev] found attractive, and in the process discovered that stacking two different Fresnel lenses and putting them in a 3D printed housing yielded a very compact pancake-like unit that gave encouraging results.

This project is still in development, and while the original lens assembly is detailed in this build log, there are some potential improvements to be made, so stay tuned if you’re interested in using this design. A DIY headset doesn’t mean you also must DIY the lenses entirely from scratch, and this option seems economical enough to warrant following up.

Want to experiment with mixing and matching optics on your own? Not only has [WalkerDev]’s project shown that off-the-shelf Fresnel lenses can be put to use, it’s in a way good news that phone-based VR is dead. Google shipped over 10 million cardboard headsets and Gear VR sold over 5 million units, which means there are a whole lot of lenses in empty headsets laying around, waiting to be harvested and repurposed.

Pixel Pump, The Open Source Vacuum Pickup Tool Is Now Shipping

The Pixel Pump is an open source manual pick & place assist tool by [Robin Reiter], and after a long road to completion, it’s ready to ship. We first saw the Pixel Pump project as an entry to the 2021 Hackaday Prize and liked the clean design and the concept of a completely open architecture for a tool that is so valuable to desktop assembly. It’s not easy getting hardware off the ground, but it’s now over the finish line and nearly everything — from assembly to packaging — has been done in-house.

Pixel Pump with SMD-Magazines, also using foot pedal to control an interactive bill of materials (BoM) plugin.

Because having parts organized and available is every bit as important as the tool itself, a useful-looking companion item for the Pixel Pump is the SMD-Magazine. This is a container for parts that come on SMD tape rolls. These hold components at an optimal angle for use with the pickup tool, and can be fixed together on a rail to create project-specific part groups.

A tool being open source means giving folks a way to modify or add features for better workflows, and an example of this is [Robin]’s suggestion of using a foot pedal for hands-free control of the interactive BoM plugin. With it, one can simply use a foot pedal to step through a highlighted list of every part for a design, an invaluable visual aid when doing hand assembly.

The Pixel Pump looks great, but if you’d prefer to go the DIY route for vacuum pickup tools you would certainly be in good company. We’ve seen economical systems built for under $100, and systems built around leveraging bead-handling tools intended for hobbyists. On the extreme end there’s the minimalist approach of building a tool directly around a small electric vacuum pump.

What Does It Take For A LEGO Car To Roll Downhill Forever?

Cars (including LEGO ones) will roll downhill. In theory if the hill were a treadmill, the car could roll forever. In practice, there are a lot of things waiting to go wrong to keep this from happening. If you’ve ever wondered what those problems would be and what a solution would look like, [Brick Technology] has a nine-minute video showing the whole journey.

The video showcases an iterative process of testing, surfacing a problem, redesigning to address that problem, and then back to testing. It starts off pretty innocently with increasing wheel friction and adding weight, but we’ll tell you right now it goes in some unexpected directions that show off [Brick Technology]’s skill and confidence when it comes to LEGO assemblies.

You can watch the whole thing unfold in the video, embedded below. It’s fun to see how the different builds perform, and we can’t help but think that the icing on the cake would be LEGO bricks with OLED screens and working instrumentation built into them.

Continue reading “What Does It Take For A LEGO Car To Roll Downhill Forever?”

Splitting 3D Prints Into Parts Can Add Strength

One of the great things about 3D printers is their ability to make a single part all at once. Separating a part into multiple pieces is usually done to split up objects that are too big to fit on the 3D printer’s print bed. But [Peter] at Markforged (manufacturers of high-end 3D printers) has a video explaining another reason: multi-part prints can benefit from improved strength.

This part can be easily printed as a single piece, but it can be made nearly twice as strong when printed as two, and combined.

The idea is this: filament-based 3D printers generally create parts that are strongest along their X-Y axis (relative to their manufacture) and weakest in the Z direction. [Peter] proposes splitting a part into pieces with this in mind. Not because the part is inconveniently large or has tricky geometry, but so the individual pieces can be printed in orientations that provide the best mechanical strength.

This is demonstrated with the simple part shown here. The usual way to print this part would be flat on a print bed, but by splitting the parts into two and printing each in their optimal orientation, the combined part withstands nearly twice as much force before failing.

[Peter]’s examples use Markforged’s own filaments, but gives advice on more common polymers as well and the same principles apply. This idea is one worth keeping in mind the next time one is seeking to optimize strength. because of how simple it is.

We’ve seen a variety of methods to toughen up or ruggedize prints in the past, but they’re usually more complex (or at least messier.) Examples include embedding braided steel cable, embedding fiberglass mesh, applying electroplating to a printed structure, and plain old embedding some bolts and washers to buffer load-bearing areas.

Continue reading “Splitting 3D Prints Into Parts Can Add Strength”

GETMusic Uses Machine Learning To Generate Music, Understands Tracks

Music generation guided by machine learning can make great projects, but there’s not usually much apparent control over the results. The system makes what it makes, and it’s an achievement if the results are not obvious cacophony. But that’s all different with GETMusic which allows for a much more involved approach because it understands and is able to create music by tracks. Among other things, this means one can generate a basic rhythm and melody first, then add additional elements to those existing ones, leaving the previous elements unchanged.

GETMusic can make music from scratch, or guided from examples, and under the hood uses a diffusion-based approach similar to the method behind AI image generators like Stable Diffusion. We’ve previously covered how Stable Diffusion works, but instead of images the same basic principles are used to guide the model from random noise to useful tracks of music.

Just a few years ago we saw a neural network trained to generate Bach, and while it was capable of moments of brilliance, it didn’t produce uniformly-listenable output. GETMusic is on an entirely different level. The model and code are available online and there is a research paper to accompany it.

You can watch a video putting it through its paces just below the page break, and there are more videos on the project summary page.

Continue reading “GETMusic Uses Machine Learning To Generate Music, Understands Tracks”

Beautifully Rebuilding A VR Headset To Add AR Features

[PyottDesign] recently wrapped up a personal project to create himself a custom AR/VR headset that could function as an AR (augmented reality) platform, and make it easier to develop new applications in a headset that could do everything he needed. He succeeded wonderfully, and published a video showcase of the finished project.

Getting a headset with the features he wanted wasn’t possible by buying off the shelf, so he accomplished his goals with a skillful custom repackaging of a Quest 2 VR headset, integrating a Stereolabs Zed Mini stereo camera (aimed at mixed reality applications) and an Ultraleap IR 170 hand tracking module. These hardware modules have tons of software support and are not very big, but when sticking something onto a human face, every millimeter and gram counts.

Continue reading “Beautifully Rebuilding A VR Headset To Add AR Features”