Dr. Niels Olson uses the Augmented Reality Microscope. (Credit: US Department of Defense)

Google’s Augmented Reality Microscope Might Help Diagnose Cancer

October 1, 2023 by Maya Posch 10 Comments

Despite recent advances in diagnosing cancer, many cases are still diagnosed using biopsies and analyzing thin slices of tissue underneath a microscope. Properly analyzing these tissue sample slides requires highly experienced and skilled pathologists, and remains subject to some level of bias. In 2018 Google announced a convolutional neural network (CNN) based system which they call the Augmented Reality Microscope (ARM), which would use deep learning and augmented reality (AR) to assist a pathologist with the diagnosis of a tissue sample. A 2022 study in the Journal of Pathology Informatics by David Jin and colleagues (CNBC article) details how well this system performs in ongoing tests.

For this particular study, the LYmph Node Assistant (LYNA) model was investigated, which as the name suggests targets detecting cancer metastases within lymph node biopsies. The basic ARM setup is described on the Google Health GitHub page, which contains all of the required software, except for the models which are available on request. The ARM system is fitted around an existing medical-grade microscope, with a camera feeding the CNN model with the input data, and any relevant outputs from the model are overlaid on the image that the pathologist is observing (the AR part).

Although the study authors noted that they saw potential in the technology, as with most CNN-based systems a lot depends on how well the training data set was annotated. When a grouping of tissue including cancerous growth was marked too broadly, this could cause the model to draw an improper conclusion. This makes a lot of sense when one considers that this system essentially plays ‘cat or bread’, except with cancer.

These gotchas with recognizing legitimate cancer cases are why the study authors see it mostly as a useful tool for a pathologist. One of the authors, Dr. Niels Olsen, notes that back when he was stationed at the naval base in Guam, he would have liked to have a system like ARM to provide him as one of the two pathologists on the island with an easy source of a second opinion.

(Heading image: Dr. Niels Olson uses the Augmented Reality Microscope. (Credit: US Department of Defense) )

Inverse Vaccines Could Help Treat Autoimmune Conditions

September 25, 2023 by Lewin Day 78 Comments

Autoimmune diseases occur when the immune system starts attacking the body’s own cells. They can cause a wide range of deleterious symptoms that greatly reduce a patient’s quality of life. Treatments often involve globally suppressing the immune system, which can lead to a host of undesirable side effects.

However, researchers at the University of Chicago might have found a workaround by tapping into the body’s own control mechanisms. It may be possible to hack the immune system and change its targeting without disabling it entirely. The new technique of creating “inverse vaccines” could revolutionize the treatment of autoimmune conditions.

Continue reading “Inverse Vaccines Could Help Treat Autoimmune Conditions” →

Bespoke Implants Are Real—if You Put In The Time

September 6, 2023 by Brian McEvoy 23 Comments

A subset of hackers have RFID implants, but there is a limited catalog. When [Miana] looked for a device that would open a secure door at her work, she did not find the implant she needed, even though the lock was susceptible to cloned-chip attacks. Since no one made the implant, she set herself to the task. [Miana] is no stranger to implants, with 26 at the time of her talk at DEFCON31, including a couple of custom glowing ones, but this was her first venture into electronic implants. Or electronics at all. The full video after the break describes the important terms.

The PCB antenna in an RFID circuit must be accurately tuned, which is this project’s crux. Simulators exist to design and test virtual antennas, but they are priced for corporations, not individuals. Even with simulators, you have to know the specifics of your chip, and [Miana] could not buy the bare chips or find a datasheet. She bought a pack of iCLASS cards from the manufacturer and dissolved the PVC with acetone to measure the chip’s capacitance. Later, she found the datasheet and confirmed her readings. There are calculators in lieu of a simulator, so there was enough information to design a PCB and place an order.

The first batch of units can only trigger the base station from one position. To make the second version, [Miana] bought a Vector Network Analyzer to see which frequency the chip and antenna resonated. The solution to making adjustments after printing is to add a capacitor to the circuit, and its size will tune the system. The updated design works so a populated board is coated and implanted, and you can see an animated loop of [Miana] opening the lock with her bare hand.

Biohacking can be anything from improving how we read our heart rate to implanting a Raspberry Pi.

Continue reading “Bespoke Implants Are Real—if You Put In The Time” →

Close-up of a magnetic tentacle robot next to a phantom bronchiole (Credit: University of Leeds)

The Healing Touch Of Magnetic Tentacles In Photothermal Lung Cancer Therapy

August 28, 2023 by Maya Posch 11 Comments

Of the body’s organs, the lungs are among the trickiest to take a biopsy and treat cancer in, both due to how important they are, as well as due to their inaccessibility. The total respiratory surface within the average human lungs is about 50 to 75 square meters. Maneuvering any kind of instrument down the endless passages to reach a suspicious area, or a cancerous region to treat is nearly impossible. This has so far left much of the lungs inaccessible.

The standard of care for lung cancer is generally surgical: remove parts of the lung tissue. However, a proposed new method using magnetic tentacles may soon provide a more gentle approach, as described in Nature Engineering Communications by Giovanni Pittiglio and colleagues (press release).

The tentacles are made out of a silicone substrate with embedded magnets that allow for it to be steered using external magnetic sources. With an embedded laser fiber, the head of the tentacle can be guided to the target area, and the cancerous tissue sublimated using an external laser source. In experiments on cadavers with this system, the researchers found that they could enter 37% deeper into the lungs than with standard equipment. The procedure was also completed with less tissue displacement.

Considering the high fatality rate of lung cancers, the researchers hope that this approach could soon be turned into a viable therapy, as well as for other medical conditions where a gentle tentacle slithering into the patient’s body could effect treatments previously considered to be impossible.

Heading image: Close-up of a magnetic tentacle robot next to a phantom bronchiole (Credit: University of Leeds)

A credit card-sized PCB with two sensing pads and a small OLED display

Card/IO Is A Credit Card-Sized, Open Source ECG Monitor

August 27, 2023 by Robin Kearey 23 Comments

Of all the electrical signals generated by the human body, those coming from the heart are probably the most familiar to the average person. And because it’s also quite simple to implement the required sensors, it makes sense that electrocardiogram (ECG) machines are a popular choice among introductory medical electronics projects. [Dániel Buga], for instance, designed a compact ECG system the size of a credit card, cleverly dubbed Card/IO, that clearly demonstrates how to implement a single-lead ECG.

Although obviously not a medical-grade instrument, it still contains all the basic components that make up a proper biosignal sensing system. First, there are the sensing pads, which sense the voltage difference between the user’s two thumbs and simultaneously cancel their common-mode voltage with a technique called Right Leg Driving (RLD). The differential signal then goes through a low-pass filter to remove high-frequency noise, after which it enters an ADS1291 ECG analog front-end chip.

The ADS1291 contains a delta-sigma analog-to-digital converter as well as an SPI bus to communicate with the main processor. [Dániel] chose an ESP32-S3, programmed in Rust, to interface with the SPI bus and drive a 1″ OLED display that shows the digitized ECG signal. It also runs the user interface, which is operated using the ECG sensing pads: if you touch them for less than five seconds, the device goes into menu mode and the two pads become buttons to scroll through the different options.

All source code, as well as KiCad files for the board, can be found on the project’s GitHub page. If you’re just getting started in the biosensing field, you might also want check out this slightly more advanced project that includes lots of relevant safety information.

Continue reading “Card/IO Is A Credit Card-Sized, Open Source ECG Monitor” →

Showing pulse oximeter and color sensor combining to measure oxygen in blood and skin tone

Perfecting The Pulse Oximeter

August 7, 2023 by Orlando Hoilett 28 Comments

We’re always looking for interesting biohacks here on Hackaday, and this new research article describing a calibrated pulse oximeter for different skin tones really caught our attention.

Pulse oximeters are handy little instruments that measure your blood oxygen saturation using photoplethysmography (PPG) and are a topic we’re no strangers to here at Hackaday. Given PPG is an optical technique, it stands to reason that its accuracy could be significantly affected by skin tone and that has been a major topic of discussion recently in the medical field. Given the noted issues with pulse oximeter accuracy, these researchers endeavored to create a better pulse oximeter by quantifying skin pigmentation and using that data to offset errors in the pulse oximeter measurements. A slick idea, but we think their results leave a lot to be desired.

Their idea sounds pretty straightforward enough. They created their own hardware to measure blood oxygen saturation, a smartwatch that includes red and infrared (IR) light-emitting diodes (LED) to illuminate the tissue just below the surface of the skin, and a photosensor for measuring the amount of light that reflects off the skin. But in addition to the standard pulse oximeter hardware, they also include a TCS34725 color sensor to quantify the user’s skin tone.

So what’s the issue? Well, the researchers mentioned calibrating their color sensor to a standard commercially-available dermatology instrument just to make sure their skin pigmentation values match a gold standard, but we can’t find that data, making it a bit hard to evaluate how accurate their color sensor actually is. That’s pretty crucial to their entire premise. And ultimately, their corrected blood oxygen values don’t really seem terribly promising either. For one individual, they reduced their error from 5.44% to 0.82% which seems great! But for another user, their error actually increases from 0.99% to 6.41%. Not so great. Is the problem in their color sensor calibration? Could be.

We know from personal experience that pulse oximeters are hard, so we applaud their efforts in tackling a major problem. Maybe the Hackaday community could help them out?

Fiber-Infused Ink Allows 3D-Printed Heart Muscle To Beat

July 29, 2023 by Maya Posch 7 Comments

Illustration from Anatomy & Physiology, Connexions Web site. http://cnx.org/content/col11496/1.6/, Jun 19, 2013.

What makes a body’s organs into what they are is more than just a grouping of specialized cells. They also need to be oriented and attached to each other and scaffolding in order to create structures which can effectively perform the desired function. A good example here is the heart, which requires a large number of muscle cells to contract in unison in order for the heart component (like a ventricle) to effectively pump blood. This complication is what has so far complicated efforts to 3D print complex tissues and entire organs, but recently researchers have demonstrated a way to 3D print heart muscle which can contract when stimulated similarly to a human heart’s ventricle.

At the center of this technique lies a hydrogel that is infused with gelatin fibers. Using a previously developed Rotary Jet-Spinning technology that was reported on in 2016, a sheet of spun fibers was produced that were then cut up into micrometer-sized fibers which were dispersed into the hydrogel. After printing the desired structure – taking into account the fiber alignment – it was found that the cardiomyocytes (the cells responsible for carrying the contractile signal in the heart muscle) align along the thus laid out pattern, ultimately creating a cardiac muscle capable of organized contraction.

These findings come after many years of research into the topic, with e.g. Zihan Wang and colleagues in a 2021 paper reporting on the challenges remaining with 3D printing cardiac tissue, yet also the massive opportunities that this could provide. Although entire heart replacements (via therapeutic cloning with the patient’s own cells) might become possible too, more immediate applications would involve replacements for damaged cardiac muscle and other large structures of the heart.