An LLM From “Scratch”

Reading a book about bowling is not the same as actually bowling. If that resonates with you and you want to learn more about large language models, check out the LLM From Scratch project. The hands-on workshop lets you use a Mac, Linux, or Windows PC running Python and common libraries like numpy and torch to build your own bare-bones LLM.

The project takes inspiration from nanoGPT but scales it down so you can train the model in around an hour on a typical computer. It will use an Apple or NVIDIA GPU, if available.

Continue reading “An LLM From “Scratch””

Learn Programming Without A Computer

Presumably aimed at children, NHK World’s Texico program teaches the main ideas about programming without actually using a computer. Instead, it uses items like a toy train, playing cards, and other gadgets to teach concepts such as analysis, combination, simulation, abstraction, and more.

There are ten episodes in English and French. Some of them are more about critical thinking, which, admittedly, is important for solving problems in general with or without a computer. For example, a “magic” trick relies on the observation that tearing a sheet of paper into nine rectangular pieces will mean each piece has at least one perfectly straight edge except for the center piece.

Continue reading “Learn Programming Without A Computer”

A 1947 Radio Gets A Face Lift

We’ve all done it. We spy an old radio at a garage sale or resale shop. We know someone should bring it back to life, but it looks like a project, so we pass it by. Not [Ken] from [Ken’s Shop]. He found an Arvin 664A AM radio from 1947 in what appears to be a home-built cabinet and decided to bring it back to life.

From what we could find, the original case was a white plastic, not the wood box it is in today. So the first challenge was simply getting inside to see what was going on. Continue reading “A 1947 Radio Gets A Face Lift”

Retrotechtacular: Julius Sumner Miller Breaks Lamps With Magnets

If you watched the Mickey Mouse Club way back when, you might remember Professor Wonderful, who was, in reality, physics professor [Julius Sumner Miller]. He also had his own show, “Why Is It So?” along with appearances on talk shows. We recently ran across one of the shows from 1962 where [Miller] uses electromagnets to break a lamp.

[Miller] moved to Australia, and this episode is from the Australian version of “Why Is It So?” As you might expect, given the topic, the professor covers Oersted and Faraday.

Continue reading “Retrotechtacular: Julius Sumner Miller Breaks Lamps With Magnets”

Matching Transistors

Transistors in some circuit configurations work together and, frequently, need to be matched. This is so common that you can sometimes find ICs that are just a pair of transistors made with the same piece of silicon, so they should be matched very closely by default. But with discrete transistors, two devices of the same type are not always identical. [Learn Electronics Repair] covers the topic and explains how to match devices in the video below.

Depending on the circuit, the matching parameters may be different, but generally, the idea is that you want similar gains or matching saturation characteristics. The reason is that when you have multiple transistors working together, you don’t want one to do more work than the other device. This is inefficient and could drive the “better” component to fail.

Continue reading “Matching Transistors”

AT&T’s Unix PC — We Hardly Knew You

Before Linux, there was Unix. It was great, but it was and has been plagued by problems with licensing and proprietary competition. [Vintage Appartus] recalls, for example, the AT&T Unix PC from the 1980s. It was awesome, but you’ve probably never heard of it. For 1985, it was a nice setup. You got a 10 MHz Motorola 68010, 512K of RAM (but upgradable to 4M), a floppy, a modem, a 720×384 monochrome screen, and a 10 or 20 MB hard drive. You can check out the video explaining the machine and its problems below.

Physically, the computer looked like a high-end Apple ][ with a removable keyboard and a built-in monitor. Expansion was via three slots. Cold start took about three minutes, and then you have a fairly normal Unix setup for the period.

Continue reading “AT&T’s Unix PC — We Hardly Knew You”

Electronics Near Zero

Normally, when you design an electronic gadget, you worry about how hot it will get. Automotive-grade components, for example, often have higher allowable temperatures than commercial parts. However, extremely cold environments, such as deep space or the interiors of quantum computers, are also challenging. Researchers at King Abdullah University of Science and Technology believe gallium oxide may be key to operating near absolute zero.

According to [Vishal Khandelwal], one of the researchers, most conventional electronics fail below -173C or 100K. Quantum computers routinely operate at 4K. However, β-Ga2O3 is a wide-bandgap semiconductor that has low current leakage and works at high temperatures up to 500C. However, it also avoids the freeze-out effect that traps electrons in other semiconductor materials.

Continue reading “Electronics Near Zero”