Hands-On: Flying Drones With Scratch

I’ll admit it. I have a lot of drones. Sitting at my desk I can count no fewer than ten in various states of flight readiness. There are probably another half dozen in the garage. Some of them cost almost nothing. Some cost the better part of a thousand bucks. But I recently bought a drone for $100 that is both technically interesting and has great potential for motivating kids to learn about programming. The Tello is a small drone from a company you’ve never heard of (Ryze Tech), but it has DJI flight technology onboard and you can program it via an API. What’s more exciting for someone learning to program than using it to fly a quadcopter?

For $100, the Tello drone is a great little flyer. I’d go as far as saying it is the best $100 drone I’ve ever seen. Normally I don’t suggest getting a drone with no GPS since the price on those has come down. But the Tello optical sensor does a great job of keeping the craft stable as long as there is enough light for it to see. In addition, the optical sensor works indoors unlike GPS.

But if that was all there was to it, it probably wouldn’t warrant a Hackaday post. What piqued my interest was that you can program the thing using a PC. In particular, they use Scratch — the language built at MIT for young students. However, the API is usable from other languages with some work.

Information about the programming environment is rather sparse, so I dug in to find out how it all worked.

Continue reading “Hands-On: Flying Drones With Scratch”

MIT Breaks Autonomous Drone Speed Limits By Not Sweating Obstacles

How does one go about programming a drone to fly itself through the real world to a location without crashing into something? This is a tough problem, made even tougher if you’re pushing speeds higher and high. But any article with “MIT” implies the problems being engineered are not trivial.

The folks over at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have put their considerable skill set to work in tackling this problem. And what they’ve come up with is (not surprisingly) quite clever: they’re embracing uncertainty.

Why Is Autonomous Navigation So Hard?

Suppose we task ourselves with building a robot that can insert a key into the ignition switch of a motor vehicle and start the engine, and could do so in roughly the same time-frame that a human could do — let’s say 10 seconds. It may not be an easy robot to create, but we can all agree that it is very doable. With foreknowledge of the coordinate information of the vehicle’s ignition switch relative to our robotic arm, we can place the key in the switch with 100% accuracy. But what if we wanted our robot to succeed in any car with a standard ignition switch?

Now the location of the ignition switch will vary slightly (and not so slightly) for each model of car. That means we’re going to have to deal with this in real time and develop our coordinate system on the fly. This would not be too much of an issue if we could slow down a little. But keeping the process limited to 10 seconds is extremely difficult, perhaps impossible. At some point, the amount of environment information and computation becomes so large that the task becomes digitally unwieldy.

This problem is analogous to autonomous navigation. The environment is always changing, so we need sensors to constantly monitor the state of the drone and its immediate surroundings. If the obstacles become too great, it  creates another problem that lies in computational abilities… there is just too much information to process. The only solution is to slow the drone down. NanoMap is a new modeling method that breaks the artificial speed limit normally imposed with on-the-fly environment mapping.

Continue reading “MIT Breaks Autonomous Drone Speed Limits By Not Sweating Obstacles”

Watching The Watchers: Are You The Star Of An Encrypted Drone Video Stream?

Small aircraft with streaming video cameras are now widely available, for better or worse. Making eyes in the sky so accessible has resulted in interesting footage that would have been prohibitively expensive to capture a few years ago, but this new creative frontier also has a dark side when used to violate privacy. Those who are covering their tracks by encrypting their video transmission should know researchers at Ben-Gurion University of the Negev demonstrated such protection can be breached.

The BGU team proved that a side-channel analysis can be done against behavior common to video compression algorithms, as certain changes in video input would result in detectable bitrate changes to the output stream. By controlling a target’s visual appearance to trigger these changes, a correlating change in bandwidth consumption would reveal the target’s presence in an encrypted video stream.

Continue reading “Watching The Watchers: Are You The Star Of An Encrypted Drone Video Stream?”

High-Speed Drones Use AI To Spoil The Fun

Some people look forward to the day when robots have taken over all our jobs and given us an economy where we can while our days away on leisure activities. But if your idea of play is drone racing, you may be out of luck if this AI pilot for high-speed racing drones has anything to say about it.

NASA’s Jet Propulsion Lab has been working for the past two years to develop the algorithms needed to let high-performance UAVs navigate typical drone racing obstacles, and from the look of the tests in the video below, they’ve made a lot of progress. The system is vision based, with the AI drones equipped with wide-field cameras looking both forward and down. The indoor test course has seemingly random floor tiles scattered around, which we guess provide some kind of waypoints for the drones. A previous video details a little about the architecture, and it seems the drones are doing the computer vision on-board, which we find pretty impressive.

Despite the program being bankrolled by Google, we’re sure no evil will come of this, and that we’ll be in no danger of being chased down by swarms of high-speed flying killbots anytime soon. For now we can take solace in the fact that JPL’s algorithms still can’t beat an elite human pilot like [Ken Loo], who bested the bots overall. But alarmingly, the human did no better than the bots on his first lap, which suggests that once the AI gets a little creativity and intuition like that needed to best a Go champion, [Ken] might need to find another line of work.

Continue reading “High-Speed Drones Use AI To Spoil The Fun”

Friday Hack Chat: All About Drones

In the future, drones will fill the skies. The world is abuzz (ha!) with news of innovative uses of unmanned aerial vehicles. Soon, our flying robotic overlords will be used for rescue operations, surveillance, counter-insurgency missions, terrorism, agriculture, and delivering frozen dog treats directly from the local Amazon aerodrome to your backyard. The future is nuts.

For this week’s Hack Chat, we’re going to be talking all about unmanned aerial vehicles. This is a huge subject, ranging from aeronautical design, the legal implications of autonomous flying machines, the true efficiency of delivering packages via drones, and the moral ambiguity of covering a city with thousands of mobile, robotic observation posts. In short, the future will be brought to us thanks to powerful brushless motors and lithium batteries.

Our guest for this week’s Hack Chat will be [Piotr Esden-Tempski], developer of UAV autopilot hardware for Paparazzi UAV. Paparazzi can be used for autonomous flight and control of multiple aircraft, and we’ll be talking about the types of embedded systems that can be used for these applications. [Pitor] is also the developer of the 1Bitsy ARM dev platform, the Black Magic Probe JTAG/SWD programmer/debugger and the founder of 1BitSquared.

In this Hack Chat, we’ll be discussing Open Source hardware design for UAVs, all things airborne robotics, the sensors that go into these flying robots, the stalled development (ay, another pun) of consumer and prosumer fixed-wing UAVs, ARM embedded systems, and JTAG and SWD programming and debugging. We’re also taking questions from the audience, and here’s the spreadsheet that will guide the discussion.

Here’s How To Take Part:

join-hack-chatOur Hack Chats are live community events on the Hackaday.io Hack Chat group messaging. This Hack Chat will be going down noon, Pacific time on Friday, September 22nd. Sidereal and solar getting you down? Wondering when noon is this month? Not a problem: here’s a handy countdown timer!

Click that speech bubble to the right, and you’ll be taken directly to the Hack Chat group on Hackaday.io.

You don’t have to wait until Friday; join whenever you want and you can see what the community is talking about.

Flying Defibrillators

It’s a sad reality that, by and large, cardiopulmonary resuscitation (CPR) doesn’t save lives. Despite all the “you could save a life” marketing aimed at getting people certified in CPR, the instances where even the prompt application of the correct technique results in a save are vanishingly rare, and limited mostly to witnessed arrests in a hospital. Speaking from personal experience, few things are sadder than arriving on-scene as a first responder to see CPR being performed by a husband on his wife and knowing that no matter what we do, it’s not going to end well.

The problem is one of time. Hearts only rarely just stop beating outright; usually some kind of arrhythmia first causes the heart to beat ineffectively, leading to hypoxia and loss of consciousness. From there it’s about a four-minute trip to brain death, but in that brief window chances are pretty good that the heart can be restarted. That’s why witnessed cardiac arrests in a hospital have better survival rates — the needed electric reboot of the heart with a defibrillator is only as far away as the nearest crash cart.

The advent of the automatic external defibrillator (AED) has increased the odds for survival of out-of-hospital cardiac arrest (OHCA), but the penetration of AEDs into public settings is far from complete enough to put one within a few minutes reach of everyone who might need one. So it’s only natural that thoughts would turn to delivering AEDs to cardiac incidents by drones. It seems like a great idea, but will it work? Continue reading “Flying Defibrillators”

Automate The Freight: Maritime Drone Deliveries

Ships at sea are literally islands unto themselves. If what you need isn’t on board, good luck getting it in the middle of the Pacific. As such, most ships are really well equipped with spare parts and even with raw materials and the tools needed to fabricate most of what they can’t store, and mariners are famed for their ability to make do with what they’ve got.

But as self-sufficient as a ship at sea might be, the unexpected can always happen. A vital system could fail for lack of a simple spare part, at best resulting in a delay for the shipping company and at worst putting the crew in mortal danger. Another vessel can be dispatched to assist, or if the ship is close enough ashore a helicopter rendezvous might be arranged. Expensive options both, which is why some shipping companies are experimenting with drone deliveries to and from ships at sea. Continue reading “Automate The Freight: Maritime Drone Deliveries”