Head mounted camera tracks with your eyes

The EyeSeeCam is a rig that attaches to your noggin and points a camera wherever your gaze falls. There’s actually four cameras involved here, one to track each eye via a reflecting piece of acrylic, one as your third eye, and finally the tracking camera above that. There are some legitimate medical uses for this type of technology, but we enjoyed seeing some of the videos that [Johannes Vockeroth] put together showing everyday activities. We’ve embedded several clips after the break including an example of reading a book while wearing the apparatus. The third eye camera provides the wide shot with close-ups of the wearer’s visual focus.

Eye tracking camera

Read a book with the EyeSeeCam

Opthalmologic applications

[Thanks The Ideanator]

Comments

  1. IceUck says:

    I see a day not too far off when everyone will be wearing these spiffy looking things.

  2. sm10sm20 says:

    wtf did he put in her ear?!

  3. DerAxeman says:

    Unfortunately I think this will cause people to end up cross eyed just like the invention Steve Martin’s character came up with in the movie “The Jerk”

  4. Anon says:

    Lulz at the third eye link

  5. supershwa says:

    Cool – now video games will be even more interactive…

  6. eyesopen says:

    I can’t wait to wear it on a date.

  7. I forsee papers on a medical condition called wondering eyes…

    But seriously could quantify/help with making people aware of ADD habits and things…

  8. polymath says:

    I would only get into trouble if any one but me reviewed the recordings.

  9. DPTR says:

    This could be very useful for marketers to determine exactly what someone see’s first or notices more in an advertisement.

    This could result in dramatically more effective advertisement… kinda scary really.

  10. ginge says:

    Why track both eyes? Surely you only need to track one eye to determine direction?

  11. DPTR says:

    Also, take the camera off and put a lazer pointer (or a weapon) and all of a sudden you have someing VERY scary…

  12. otacon says:

    @ginge: There are medical uses, as you see in the videos. If, for example, your eyes’ mobility is checked, it can differ between both.

  13. andar_b says:

    @polymath

    Yeah, I’d be in trouble if any of the *ahem* non-male office staff were to review it :p

  14. Colecoman1982 says:

    @ginge: Actually, you need two. For example, if you tracked one of a person’s eyes moving in towards the nose, you wouldn’t be able to tell if they were looking at something to the side, or if they were focusing on something really close to them. You need to know where the other eye is in order to know that.

  15. jake says:

    @ginge: cause one eye isn’t always enough. Some people , myself included , only look in “the proper direction” with one eye at a time, the other one just hovers somewhere. See strabismus.

  16. bramlet says:

    now if only they could control your eye nerve. you could record the good kids reading the book and then force the bad kids eyes to look at every word.

  17. braingram says:

    @sm10sm20

    Water. Look up Caloric stimulation. Cold water in your ear causes your eyes to quickly move (saccade) away from the cold water and then slowly drift back (nystagmus). Warm water causes the opposite.

    I’d love to see an open source one of these (maybe made with ps3eye cameras).

  18. The Ideanator says:

    Hey cool! You did do a writeup on that. Neat.

  19. brsnow says:

    Well, this is really pretty cool. The applications for augmented reality are mindblowing. I would much rater wear a pair of glasses than put an electric contact in my eye. The software just needs to be a little faster or people are going to start getting motion sick and have seizures with all the jerky video.

  20. brandonman says:

    Funny, we were just talking about how awkward it would be to have one of these follow your titty-vision in Math class today :P

  21. Hirudinea says:

    Now you can take video of all the women who will never, EVER sleep with you.

  22. Phil says:

    This reminds me off all the targeting systems in Gundam and the like anime, how they just look at something and it targets it :D just an idea.

  23. pascal says:

    Nicely done, especially the tracking seems very precise. This can be easily adapted to control a computer’s cursor on screen: just detect the screen corners in the 3rd eye camera and project the focus point onto it.
    Should also work with a WiiMote and just a single webcam on one eye.
    I tried this once, but 320×240 resolution wasn’t nearly enough. (Also I didn’t use the mirrors and had to look at the eyes at extreme angles to not obstruct the view. Barely precise enough to select something on a 3×3-Grid).

    What I’d like to see: instead of USB webcams use android phone(s). More freedom. (If you aren’t too embarrased to explain it, you could even leave the house. And prove that you totally look at peoples faces)

  24. drew says:

    @ DPTR & Phil-

    That’s exactly what I was thinking- this needs to be combined with 3 laser pointers- and wala, PREDATOR targeting!

    This rocks HARD.

  25. 3rdStrike says:

    I can just see women making their husbands(or boyfriend) wear this so they can confront them with solid evidence that they did indeed look at the really hot girl that just strolled by.

  26. Juan Pablo Kutianski says:

    @DPTR

    That exist on the AH-64 Apache

  27. @braingram
    thanks, I was wondering what’s up with that!

  28. Tachikoma says:

    This could work with FPS games as well. You no longer need to move the mouse for centring the screen at individual objects in the scene, you simply look at it.

  29. Mike says:

    Cyclops from X-Men video game anyone?

  30. nebulous says:

    @ Tachikoma
    So moving to look at something off-center moves it to the center, so you move your eyes to the center and the screen moves again. Even more frustrating than that trick with the icon that jumps around when you try to click it. :-)

  31. Trav says:

    @Pascal
    This looks like something quadriplegics could use. Just look at the computer screen, and then blink a pattern for clicks.

    Eye tracking has been around for some time. I remember a video about 10 yrs ago, where marketers were using eye tracking to see where people were looking at on a TV commercial. but the head had to be held still in a chin rest. This next generation seems much more versatile.

  32. walt says:

    too bad you have to have wet ears for them to work.

  33. mess_maker says:

    @brsnow:
    “The software just needs to be a little faster or people are going to start getting motion sick and have seizures with all the jerky video.”

    I am not so sure about that, I think I would have to have it on to test it. Have you ever tried to smoothly pan your eyes from as far right as you can look to as far left as you can look (of course without turning your head)? Your eye moves in jerky, non-smooth, motions. Almost stepping across your field of vision.

    You may be right, but I think it is probably closer to how your eye moves than you might think.

    The thing I would like, however, is the ability to turn on and off the maginification, or zoom at will. Also, maybe expand the field of view a little. That may all be part of the videos above, I am caching them before I finish the bottom two.

  34. Scott says:

    These exist in some military systems already, but eye-tracking is hard stuff to work with:

    http://www.airspacemag.com/need-to-know/NEED-helmets.html

  35. mess_maker says:

    D’oh! Judging by the second video I thought it was also projecting a zoomed view of what you were focusing on…

    I believe that the second video is actually a composite video output with the wide FOV with the target overlaid for demonstration purposes. Not what the wearer is actually looking at.

    Those are all cameras mounted on her head, no projectors, right?

  36. Karl says:

    Makes “The Final Cut” a little more plausible.

  37. Gagandeep Singh says:

    APPLICATION:
    Can anybody has some good application idea of this technology. It would be interesting to hear apart from video games…

  38. drew says:

    So- can anyone tell us if there are technical descriptions of how these were built- ie, do they have details on how to build these, or the code that runs them?

    If it’s just a device you can buy with 1000’s of $, I’m not interested. But if this is as simple as it looks, it could be implemented for hardware hackers.

    One question- why not have the cameras reading the reflection at 90 degrees to the eye? Why did they pick such a strange wide angle for the cameras?

    Could this not be done with smaller cameras, and right over the eyes, without reflection?

  39. Jay says:

    Now put it in a helmet so people can’t see what I’m recording for future uses.

  40. Joshua says:

    Hmmmmm…. If you could make one of these on the cheap, as I suspect you could, it would have some very real potential paired up with one of those hacked EEG games like the Mindflex or whatever.

    Also, on the idea of playing FPS with it, I believe it would be rather easy. As long as you keep your eyes on the target, it should work just fine. Granted, it would take some time to get used to, but I think it would work quite well in the end.

  41. Canon sd550 says:

    It reminds me of the Terminator. There are a lot of medical applications for it though.

  42. Dick says:

    @Joshua

    I’ve looked into eye-tracking as an input device. IMO, it is frustrating to use for an able-bodied person used to a keyboard and mouse. It’d probably be useless for an FPS. Just think about how you view things normally on a computer screen, you use your peripheral vision a lot and an eye tracker would not be able to determine that. Keeping your eyes focused on your target would probably be detrimental to your play, it’d effectively be tunnel vision. Also, your pupil doesn’t sit still, it jitters, so that would make accuracy really sub-par when compared to a good mouse.

  43. martin says:

    what kind of cameras has used?

    thanks

  44. what is the software shown in this video…pls reply me

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 94,102 other followers