Building AI Models To Diagnose HVAC Issues

HVAC – heating, ventilation, and air conditioning – can account for a huge amount of energy usage of a building, whether it’s residential or industrial. Often it’s the majority energy consumer, especially in places with extreme climates or for things like data centers where cooling is a large design consideration. When problems arise with these complex systems, they can go undiagnosed for a time and additionally be difficult to fix, leading to even more energy losses until repairs are complete. With the growing availability of platforms that can run capable artificial intelligences, [kutluhan_aktar] is working towards a system that can automatically diagnose potential issues and help humans get a handle on repairs faster.

The prototype system is designed for hydronic (water-based) systems and uses two separate artificial intelligences, one to analyze thermal imagery of the system and look for problems like leaks, hot spots, or blockages, and the other to listen for anomalous sounds especially relating to the behavior of cooling fans. For the first, a CNC-like machine was built to move a thermal camera around a custom-built model HVAC system and report its images back to a central system where they can be analyzed for anomalies. The second system which analyses audio runs its artificial intelligence on a XIAO ESP32C6 and listens to the cooling fans running in the model.

One problem that had to be tackled before any of this could be completed was actually building an open-source dataset to train the AI on. That’s part of the reason for the HVAC model in this project; being able to create problems to train the computer to detect before rolling it out to a larger system. The project’s code and training models can be found on its GitHub page. It seems to be a fairly robust solution to this problem, though, and we’ll be looking forward to future versions running on larger systems. Not everyone has a hydronic HVAC system, though. As heat pumps become more and more popular and capable, you’ll need systems to control those as well.

Ultra-Basic Thermal Camera Built Using Arduino Uno

Thermal cameras can cost well into the five-figure range if you’re buying high-resolution models with good feature sets. New models can be so advanced that their export and use is heavily controlled by certain countries, including the USA. If you just want to tinker at the low end, though, you don’t have to spend a lot of scratch. You can even build yourself something simple based on an Arduino Uno!

The build uses Panasonic’s cheap “Grid-EYE” infrared array as the thermal sensor, in this case, a model with an 8×8 array of thermopiles. It’s not going to get you any fancy images, especially at long range, but you can use it to get a very blocky kind of Predator-vision of the thermal radiation environment. It’s a simple matter of hooking up the Grid-EYE sensor to the Arduino Uno over I2C, and then spitting out the sensor’s data in a nice visual form on a cheap TFT screen.

It’s a great introduction to the world of thermal imaging. There’s no better way to learn how something works by building a working example yourself. We’ve featured a few similar projects before, too; it’s all thanks to the fact that thermal sensors are getting cheaper and more accessible than ever!

Heat Seeking Robot And Camera Tear Down

[Marco Reps] found an HT02 thermal imaging camera in his mailbox. He found the resolution was fine for looking at big objects but worthless for examining circuit boards. So he decided to just tear it into pieces — an urge we totally understand.

Inside was a thermopile sensor that was easy to reverse engineer. So [Marco] decided to rework a Raspberry Pi robot to use the camera and turn it into a heat seeker.

Continue reading “Heat Seeking Robot And Camera Tear Down”

Adding Optics To A Consumer Thermal Camera

[David Prutchi] writes in to tell us about his recent experiments with building lenses for thermal imaging cameras, which to his knowledge is a first (at least as far as DIY hardware is concerned). With his custom designed and built optics, he’s demonstrated the ability to not only zoom in on distant targets, but get up close and personal with small objects. He’s working with the Seek RevealPro, but the concept should work on hardware from other manufacturers as well.

In his detailed whitepaper, [David] starts by describing the types of lenses that are appropriate for thermal imaging. Glass doesn’t transmit the wavelengths that thermal camera is looking for, so the lenses need to be made of either germanium or zinc selenide. These aren’t exactly the kind of thing you can pick up at the local camera shop, and even small lenses made of these materials can cost hundreds of dollars. He suggests keeping an eye out on eBay for surplus optics you could pull them out of to keep costs down.

Creating the macro adapter is easy enough, you simply put a convex lens in front of the thermal camera. But telephoto is a bit more involved, and the rest of the whitepaper details the math and construction techniques used to assemble it the optics. [David] gives a complete bill of materials and cost breakdown for his telephoto converter, but prepare for a bout of sticker shock: the total cost with all new hardware is nearly $500 USD. The majority of that is for the special lenses though, so if you can score some on the second-hand market it can drop the cost significantly.

We’ve seen an impressive array of thermal camera hacks and projects recently, no doubt due to the falling prices of consumer-level imaging hardware. Given their utility as a diagnostic tool, a thermal camera might be something worth adding to your bag of tricks.

DIY Thermal Camera That’s Better And Cheaper Than A FLIR

A few years ago, FLIR unleashed a new line of handheld thermal imagers upon the world. In a manufacturing triumph, the cheapest of these thermal imaging cameras contained the same circuitry as the one that cost six times as much. Much hacking ensued. Once FLIR figured out the people who would be most likely to own a thermal imaging camera can figure out how to upload firmware, the party was over. That doesn’t mean we’re stuck with crippled thermal imaging cameras, though: we can build our own, with better specs than what the big boys are selling.

[Max] has been working on his DIY thermal imager for a while now. We first saw it about a year ago, and the results were impressive. This thermal camera is built around the FLIR Lepton sensor, providing thermal images with a resolution of 60 by 80 pixels. These thermal images were combined with a VGA resolution camera to produce the very cool enhanced imagery the commercial unit will get you. There’s also a 1/4-20 threaded insert on the bottom of [Max]’s version, making it far more useful in any experimental setup.

Now [Max] has unleashed his DIY Thermocam on the world of Open Hardware, and anyone can build their own for about €400 (about $425). The components required for this build include a FLIR Lepton sensor easily sourced from the Digikey or GroupGets, an Arducam Mini, a Teensy 3.6, and a mishmash of components that are probably kicking around your parts drawers.

If you want an overview of this project before digging in, [Max] has a project overview (PDF warning) going over the build. This is one of the better DIY projects we’ve seen recently, and the documentation is fantastic. If you’re thinking about buying one of those fancy thermal imaging cameras, here you go — this one is just as good and half off.

DIY thermal imaging heat map

DIY Thermal Imaging Done Low-Tech Style

[Niklas Roy] has always wanted to try out thermal imaging and saw his opportunity when he received one of those handheld IR thermometers as a gift. But not content with just pointing it at different spots and looking at the temperatures on the LCD display, he decided to use it as the basis for a scanning, thermal imaging system that would display a heat map of a chosen location on his laptop.

DIY thermal imaging system
DIY thermal imaging system

He still wanted to to be able to use the IR thermometer as normal at a later date so cutting it open was not an option. Instead he firmly mounted a webcam to it pointing at the LCD display. He then wrote software on his laptop to process the resulting image and figure out what temperature was being displayed.

Once he got that working, he next put the thermometer on a platform with servos connected to an Arduino for slowly rotating it in the horizontal and vertical directions, also under control of the software on his laptop. Each time the thermometer measures the temperature of a spot, the software decodes the temperature on the LCD display and then tells the Arduino to use the servos to point the thermometer at the next spot to be measured. Each measurement takes a little time, so scanning an entire location as 70×44 spots takes around a half hour. But the end result is a heat map drawn on the laptop, done by a device that is low-tech. [Editor’s Snark: Because attaching a webcam and processing the images is “low-tech” these days.] He can overlay the heat map on a normal photo to see at a glance where the hot spots are.

The software he wrote is available on GitHub and the video below shows it in action. We’ve got to admit, it’s pretty awesome to watch. You can even see the heat map being filled in one measurement at a time.

Continue reading “DIY Thermal Imaging Done Low-Tech Style”

Hackaday Prize Entry: Raspberry Pi Thermal Imaging

High up on the list of desirable technologies that are edging into the realm of the affordable for the experimenter is the thermal camera. Once the exclusive preserve of those with huge budgets, over the last few years we’ve seen the emergence of cameras that are more affordable, and most recently a selection of thermal camera modules that are definitely within the experimenter’s range. They may not yet have high resolution, but they are a huge improvement on nothing, and they are starting to appear in projects featured on sites like this one.

One such device is the Melexis MLX90621, a 16×4 pixel thermal sensor array in a TO39 can with an I2C interface. It’s hardly an impulse purchase in single quantities and nor is it necessarily the cheapest module available, but its price is low enough for [Alpha Charlie] to experiment with interfacing it to a Raspberry Pi for adding a thermal camera overlay to the pictures from its visible light camera.

The wiring for the module is simplicity itself, and he’s created a couple of pieces of software for it that are available on his GitHub repository. mlxd is a driver daemon for the module, and mixview.py is a Python graphical overlay script that places the thermal array output over the camera output. A run-through of the device and its results can be seen in the video below the break.

Continue reading “Hackaday Prize Entry: Raspberry Pi Thermal Imaging”