Head mounted camera tracks with your eyes

The EyeSeeCam is a rig that attaches to your noggin and points a camera wherever your gaze falls. There’s actually four cameras involved here, one to track each eye via a reflecting piece of acrylic, one as your third eye, and finally the tracking camera above that. There are some legitimate medical uses for this type of technology, but we enjoyed seeing some of the videos that [Johannes Vockeroth] put together showing everyday activities. We’ve embedded several clips after the break including an example of reading a book while wearing the apparatus. The third eye camera provides the wide shot with close-ups of the wearer’s visual focus.

Eye tracking camera

Read a book with the EyeSeeCam

Opthalmologic applications

[Thanks The Ideanator]

44 thoughts on “Head mounted camera tracks with your eyes

  1. Unfortunately I think this will cause people to end up cross eyed just like the invention Steve Martin’s character came up with in the movie “The Jerk”

  2. This could be very useful for marketers to determine exactly what someone see’s first or notices more in an advertisement.

    This could result in dramatically more effective advertisement… kinda scary really.

  3. Also, take the camera off and put a lazer pointer (or a weapon) and all of a sudden you have someing VERY scary…

  4. @ginge: There are medical uses, as you see in the videos. If, for example, your eyes’ mobility is checked, it can differ between both.

  5. @ginge: Actually, you need two. For example, if you tracked one of a person’s eyes moving in towards the nose, you wouldn’t be able to tell if they were looking at something to the side, or if they were focusing on something really close to them. You need to know where the other eye is in order to know that.

  6. @ginge: cause one eye isn’t always enough. Some people , myself included , only look in “the proper direction” with one eye at a time, the other one just hovers somewhere. See strabismus.

  7. now if only they could control your eye nerve. you could record the good kids reading the book and then force the bad kids eyes to look at every word.

  8. @sm10sm20

    Water. Look up Caloric stimulation. Cold water in your ear causes your eyes to quickly move (saccade) away from the cold water and then slowly drift back (nystagmus). Warm water causes the opposite.

    I’d love to see an open source one of these (maybe made with ps3eye cameras).

  9. Well, this is really pretty cool. The applications for augmented reality are mindblowing. I would much rater wear a pair of glasses than put an electric contact in my eye. The software just needs to be a little faster or people are going to start getting motion sick and have seizures with all the jerky video.

  10. Funny, we were just talking about how awkward it would be to have one of these follow your titty-vision in Math class today :P

  11. This reminds me off all the targeting systems in Gundam and the like anime, how they just look at something and it targets it :D just an idea.

  12. Nicely done, especially the tracking seems very precise. This can be easily adapted to control a computer’s cursor on screen: just detect the screen corners in the 3rd eye camera and project the focus point onto it.
    Should also work with a WiiMote and just a single webcam on one eye.
    I tried this once, but 320×240 resolution wasn’t nearly enough. (Also I didn’t use the mirrors and had to look at the eyes at extreme angles to not obstruct the view. Barely precise enough to select something on a 3×3-Grid).

    What I’d like to see: instead of USB webcams use android phone(s). More freedom. (If you aren’t too embarrased to explain it, you could even leave the house. And prove that you totally look at peoples faces)

  13. @ DPTR & Phil-

    That’s exactly what I was thinking- this needs to be combined with 3 laser pointers- and wala, PREDATOR targeting!

    This rocks HARD.

  14. I can just see women making their husbands(or boyfriend) wear this so they can confront them with solid evidence that they did indeed look at the really hot girl that just strolled by.

  15. This could work with FPS games as well. You no longer need to move the mouse for centring the screen at individual objects in the scene, you simply look at it.

  16. @ Tachikoma
    So moving to look at something off-center moves it to the center, so you move your eyes to the center and the screen moves again. Even more frustrating than that trick with the icon that jumps around when you try to click it. :-)

  17. @Pascal
    This looks like something quadriplegics could use. Just look at the computer screen, and then blink a pattern for clicks.

    Eye tracking has been around for some time. I remember a video about 10 yrs ago, where marketers were using eye tracking to see where people were looking at on a TV commercial. but the head had to be held still in a chin rest. This next generation seems much more versatile.

  18. @brsnow:
    “The software just needs to be a little faster or people are going to start getting motion sick and have seizures with all the jerky video.”

    I am not so sure about that, I think I would have to have it on to test it. Have you ever tried to smoothly pan your eyes from as far right as you can look to as far left as you can look (of course without turning your head)? Your eye moves in jerky, non-smooth, motions. Almost stepping across your field of vision.

    You may be right, but I think it is probably closer to how your eye moves than you might think.

    The thing I would like, however, is the ability to turn on and off the maginification, or zoom at will. Also, maybe expand the field of view a little. That may all be part of the videos above, I am caching them before I finish the bottom two.

  19. D’oh! Judging by the second video I thought it was also projecting a zoomed view of what you were focusing on…

    I believe that the second video is actually a composite video output with the wide FOV with the target overlaid for demonstration purposes. Not what the wearer is actually looking at.

    Those are all cameras mounted on her head, no projectors, right?

  20. APPLICATION:
    Can anybody has some good application idea of this technology. It would be interesting to hear apart from video games…

  21. So- can anyone tell us if there are technical descriptions of how these were built- ie, do they have details on how to build these, or the code that runs them?

    If it’s just a device you can buy with 1000′s of $, I’m not interested. But if this is as simple as it looks, it could be implemented for hardware hackers.

    One question- why not have the cameras reading the reflection at 90 degrees to the eye? Why did they pick such a strange wide angle for the cameras?

    Could this not be done with smaller cameras, and right over the eyes, without reflection?

  22. Hmmmmm…. If you could make one of these on the cheap, as I suspect you could, it would have some very real potential paired up with one of those hacked EEG games like the Mindflex or whatever.

    Also, on the idea of playing FPS with it, I believe it would be rather easy. As long as you keep your eyes on the target, it should work just fine. Granted, it would take some time to get used to, but I think it would work quite well in the end.

  23. @Joshua

    I’ve looked into eye-tracking as an input device. IMO, it is frustrating to use for an able-bodied person used to a keyboard and mouse. It’d probably be useless for an FPS. Just think about how you view things normally on a computer screen, you use your peripheral vision a lot and an eye tracker would not be able to determine that. Keeping your eyes focused on your target would probably be detrimental to your play, it’d effectively be tunnel vision. Also, your pupil doesn’t sit still, it jitters, so that would make accuracy really sub-par when compared to a good mouse.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s