Wireless face tracking camera

A student team at University of Massachusetts  have built this wireless face tracking camera system. Using a small 2-axis motorized camera meant to be mounted on model airplanes, an arduino, and some custom software, they can track faces and keep them in frame in real-time. This is pretty cool, but maybe not quite as groundbreaking as they make it sound. We think it is pretty awesome though. You can download the software and schematics on their site.

[via MakeZine]

Comments

  1. sibmad says:

    Hehe. A couple of years ago I made a userspace (python) driver for the Webcam Rocket Launcher (http://www.thinkgeek.com/geektoys/cubegoodies/a1c2/), making it capable of tracking and shooting faces. Made my coworkers think twice before using my office as a hallway… HOAHOAHOA (evil laughter)

  2. barry99705 says:

    Logitech has had a camera that’s been able to do this for years.

  3. dan says:

    I also did this exact thing a couple of years ago, in my spare time at work. I later changed it so that I was controlling the mouse cursor instead of the camera servos, so I could look around in FPS games by pointing my face. Since the centre of the detected face rectangle moves as you look (even slightly) left, right, up and down, you can use the difference in position to drive the cursor.

  4. toodlestech says:

    You see a Comp Sci student do this every semester at most schools. OpenCV is an open source image processing package that includes facial tracking.

  5. andrew says:

    Just from watching the vid, I can tell their face-detection is better than the stock on in OpenCV (probably because they can do more stuff more quickly on the NVIDIA GPU). I was fooling around with a processing version of what Dan was talking about just a few days ago and OpenCV loses faces if they turn even a few degrees off of center. In this video, you can see it continue to track his head at much more extreme angles (although I don’t think he got to 90 degrees). So, at least their face-tracking is good. I was hoping they trimmed it down somehow to fit on a micro-controller.

  6. kmatzen says:

    @andrew

    I can’t find any face tracking in the code. There is certainly a lot of optical flow going on, but I can’t find anything that resembles a face classifier.

    Maybe I just misunderstand the code, but it looks like it follows whatever is in the center of the frame unless the user clicks on something else.

    I doubt they could get this working on a regular microcontroller due to all the convolutions they are performing. A DSP or FPGA would work though, I think.

  7. PWRX says:

    Was it required for the guy to walk around like he had a broomstick shoved up his rear?

  8. dan says:

    If anyone else wants to try this stuff and OpenCV isn’t up to the challenge, try Neurotech’s VeriLook facial recognition SDK. There’s a 30 day trial (good enough for me to satisfy my curiosity) and I don’t think it costs that much to buy.

    They also have an OBJECT recognition sdk, which is very cool.

  9. dan says:

    Ah, it’s more expensive than I thought… we used it at work so I didn’t have to buy my own.

  10. Thank you for posting our project. Just to clarify, there is no face tracking happening in this algorithm. While many face tracking algorithms can do the same thing, they work by finding specific features. This tracking algorithm assumes nothing about the object it is tracking and still manages to outperform many face tracking algorithms. Therein lies the novelty.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 96,687 other followers