AI Upscaling And The Future Of Content Delivery

April 5, 2021 by Tom Nardi 29 Comments

The rumor mill has recently been buzzing about Nintendo’s plans to introduce a new version of their extremely popular Switch console in time for the holidays. A faster CPU, more RAM, and an improved OLED display are all pretty much a given, as you’d expect for a mid-generation refresh. Those upgraded specifications will almost certainly come with an inflated price tag as well, but given the incredible demand for the current Switch, a $50 or even $100 bump is unlikely to dissuade many prospective buyers.

But according to a report from Bloomberg, the new Switch might have a bit more going on under the hood than you’d expect from the technologically conservative Nintendo. Their sources claim the new system will utilize an NVIDIA chipset capable of Deep Learning Super Sampling (DLSS), a feature which is currently only available on high-end GeForce RTX 20 and GeForce RTX 30 series GPUs. The technology, which has already been employed by several notable PC games over the last few years, uses machine learning to upscale rendered images in real-time. So rather than tasking the GPU with producing a native 4K image, the engine can render the game at a lower resolution and have DLSS make up the difference.

The implications of this technology, especially on computationally limited devices, is immense. For the Switch, which doubles as a battery powered handheld when removed from its dock, the use of DLSS could allow it to produce visuals similar to the far larger and more expensive Xbox and PlayStation systems it’s in competition with. If Nintendo and NVIDIA can prove DLSS to be viable on something as small as the Switch, we’ll likely see the technology come to future smartphones and tablets to make up for their relatively limited GPUs.

But why stop there? If artificial intelligence systems like DLSS can scale up a video game, it stands to reason the same techniques could be applied to other forms of content. Rather than saturating your Internet connection with a 16K video stream, will TVs of the future simply make the best of what they have using a machine learning algorithm trained on popular shows and movies?

Continue reading “AI Upscaling And The Future Of Content Delivery” →

A Few Of My Favorite Things: Pens

March 29, 2021 by Kristina Panos 111 Comments

Pens! They just might be the cheapest, most important piece of technology ever overlooked by a large group of people on a daily basis. Pens are everywhere from your desk to your car to your junk drawer, though they tend to blink out of existence when you need one. Where would we be without them? Probably still drawing on cave walls with dandelions and beets.

Photo of a Pilot Metropolitan by Aaron Burden on Unsplash

Why do I think pens are so great? Well, they’re a relatively cheap tool depending on the pen you get, but whatever you spend, you’re getting a lot for your money. Pens are possibility, pure and simple, and they’re even conveniently packaged in a portable device.

Aesthetically speaking, I like pens because of how different they can be both inside and out. Some of them make thick lines, some make thin lines, and in the case of flexible nibs, some alternate between thick and thin lines depending on pressure. I use pens for a number of reasons, most notably for writing. Everything you read here that bears my name began life as pen marks on paper.

Pens are revolutionary because they can be used to make ideas permanent and/or illustrate any concept. It’s up to you to use the pen wisely. You can use other, better tools later, but pens are always a great first tool. If you’re not encumbered by an uncomfortable grip, ink that skips, or a scratchy, draggy contact point, your ideas will flow more freely. When you find the right pen for you, you aren’t hindered by your tool — you’re elevated by it. Continue reading “A Few Of My Favorite Things: Pens” →

How The LIGO Observatory Detects Gravitational Waves

March 24, 2021 by Lewin Day 43 Comments

Gravity is one of the more obvious forces in the universe, generally regarded as easily noticeable by the way apples fall from trees. However, the underlying mechanisms behind gravity are inordinately complex, and the subject of much study to this day.

A major component of this study is around the concept of gravitational waves. First posited by Henri Poincaré in 1905, and later a major component of Einstein’s general theory of relativity, they’re a phenomena hunted for by generations of physicists ever since. For the team at the Laser Interferometer Gravitational-wave Observatory, or LIGO, finding direct evidence of gravitational waves is all in a day’s work.

Continue reading “How The LIGO Observatory Detects Gravitational Waves” →

Hey Google, Is My Heart Still Beating?

March 23, 2021 by Tom Nardi 18 Comments

University of Washington researchers studying the potential medical use of smart speakers such as Amazon’s Echo and Google’s Nest have recently released a paper detailing their experiments with non-contact acoustic heartbeat detection. Thanks to their sensitive microphone arrays, normally used to help localize voice commands from the user, the team proposes these affordable and increasingly popular smart home gadgets could lead a double life as unobtrusive life sign monitors. The paper goes so far as to say that even with multiple people in the room, their technique can be used to monitor the heart and respiratory rate of a specific target individual.

Those are some bold claims, but they aren’t without precedent. Previous studies performed at UW in 2019 demonstrated how smart speaker technology could be used to detect cardiac arrest and monitor infant breathing. This latest paper could be seen as the culmination of those earlier experiments: a single piece of software that could not just monitor the vitals of nearby patients, but actually detect a medical emergency. The lifesaving potential of such a program, especially for the very young and elderly, would be incredible.

So when will you be able to install a heart monitor skill on the cheap Echo Dot you picked up on Prime Day? Well, as is often the case with this kind of research, putting the technique to work in the real-world isn’t nearly as easy as in the laboratory. While the concept is promising and is more than worthy of further research, it may be some time before our lowly smart speakers are capable of Star Trek style life-sign detection.

Continue reading “Hey Google, Is My Heart Still Beating?” →

Science Officer…Scan For Elephants!

March 17, 2021 by Al Williams 29 Comments

If you watch many espionage or terrorism movies set in the present day, there’s usually a scene where some government employee enhances a satellite image to show a clear picture of the main villain’s face. Do modern spy satellites have that kind of resolution? We don’t know, and if we did we couldn’t tell you anyway. But we do know that even with unclassified resolution, scientists are using satellite imagery and machine learning to count things like elephant populations.

When you think about it, it is a hard problem to count wildlife populations in their habitat. First, if you go in person you disturb the target animals. Even a drone is probably going to upset timid wildlife. Then there is the problem with trying to cover a large area and figuring out if the elephant you see today is the same one as one you saw yesterday. If you guess wrong you will either undercount or overcount.

The Oxford scientists counting elephants used the Worldview-3 satellite. It collects up to 680,000 square kilometers every day. You aren’t disturbing any of the observed creatures, and since each shot covers a huge swath of territory, your problem of double counting all but vanishes.

Continue reading “Science Officer…Scan For Elephants!” →

Unicode: On Building The One Character Set To Rule Them All

March 17, 2021 by Maya Posch 75 Comments

Most readers will have at least some passing familiarity with the terms ‘Unicode’ and ‘UTF-8’, but what is really behind them? At their core they refer to character encoding schemes, also known as character sets. This is a concept which dates back to far beyond the era of electronic computers, to the dawn of the optical telegraph and its predecessors. As far back as the 18th century there was a need to transmit information rapidly across large distances, which was accomplished using so-called telegraph codes. These encoded information using optical, electrical and other means.

During the hundreds of years since the invention of the first telegraph code, there was no real effort to establish international standardization of such encoding schemes, with even the first decades of the era of teleprinters and home computers bringing little change there. Even as EBCDIC (IBM’s 8-bit character encoding demonstrated in the punch card above) and finally ASCII made some headway, the need to encode a growing collection of different characters without having to spend ridiculous amounts of storage on this was held back by elegant solutions.

Development of Unicode began during the late 1980s, when the increasing exchange of digital information across the world made the need for a singular encoding system more urgent than before. These days Unicode allows us to not only use a single encoding scheme for everything from basic English text to Traditional Chinese, Vietnamese, and even Mayan, but also small pictographs called ‘emoji‘, from Japanese ‘e’ (絵) and ‘moji’ (文字), literally ‘picture word’.

Continue reading “Unicode: On Building The One Character Set To Rule Them All” →

Design Solutions For The Heat Crisis In Cities Around The World

March 16, 2021 by Lewin Day 75 Comments

It was 1999 when Smash Mouth dropped the smash hit All Star, stating “The ice we skate is getting pretty thin, the water’s getting warm so you might as well swim.” Since then, global temperatures have continued to rise, with no end in sight. Political will has been unable to make any grand changes, and the world remains on track to blow through the suggested hard limits set by scientists.

As a result, heatwaves have become more frequent, and of greater intensity, putting many vulnerable people at risk and causing thousands of deaths each year. This problem is worse in cities, where buildings and roads absorb more heat from the sun than natural landscapes do. This is referred to as the heat island effect, with cities often being several degrees warmer than surrounding natural areas. It’s significant enough that experts are worried some cities could become uninhabitable within decades. Obviously, that’s highly inconvenient for those currently living in said cities. How bad is the problem, and what can be done?

Continue reading “Design Solutions For The Heat Crisis In Cities Around The World” →