Robot eyes look where you do

This robot eye can move five times faster than the human eye. It’s capable of being used to follow a human gaze and, as you can see by that coin, it’s small enough to be used in pairs. When used to follow your gaze it needs a custom-made eye tracker. The thought here is that a lot can be learned about a person’s psyche by monitoring what they are focusing on. But we wonder about the augmented reality properties of a setup like this.

Imagine a pair of glasses as a heads up display. If this camera knows where you’re looking it can process the items in your gaze and overlay digital information. As with all new technology there are obvious military uses for this, but we’d be more interested in a Flickr pool type collection of people’s real-world experiences. Like subscribing to the locations of that thumb drive network in NYC and having the camera/glasses guide you to the nearest installation.

Want to see how fast this thing responds? Check out the video after the break.

[via Neatorama]

35 thoughts on “Robot eyes look where you do

  1. I like how it’s poking through some white board.

    Turn the picture upside down and it’s “Ceiling robot is watching you….”

  2. Given that it’s from an applied mechanics institute I would expect them to be using custom-made parts, not scavenging old CD-ROM drives.

  3. I would say that they are using linear actuators, they are using linear encoders and even how the actuator moves points to linear.

  4. We could keep guessing that they’re CD or HDD drive actuators or linear actuators, or we could read the article and discover that they are piezo actuators.
    The only piezo actuators I’ve worked with (other than in ink jet printers) are in ultrasonic welders… and they’ve got nowhere near the stroke that these do. Neat stuff.

  5. ah yes, linear actuator, I didnt know the proper name, just that this kind of mechanism is in CDROM drives
    should be fairly easy to replicate with RC Heli swashplate and 3 CDROM mechanisms
    now do only find a good use for it … :)

  6. Back to these piezo actuators again. They seem to show alot of promise. The same actuators are used to control parts of dslr lenses. Microscopic xyz table anyone? Unfortunately the article doesnt address the real show stopper when it comes to progress…

    The motors/drivers are insanely expensive to buy premade. There is also no instructions out in the wild showing how to build one, particularly recipes how to make piezo materials. I wonder if multiple layers cut up flat disk piezo buzzers on top of each other could do the trick. Removing a channel on one of these to divide it up into separately controllable sectors which warp the one disk has worked at a very tiny scale for amateur stm microscopes so I wonder if this idea could extend to linear actuators.

  7. I don’t see any reason for this to have 3 actuators. I mean I guess it’s nice for showcasing mechanics and what things can do. But twisting a camera image doesn’t have any use that I know of.

  8. zzzomb, that’s what I was afraid of. Piezoelectric actuators are exotic expensive. Couldn’t you use a servo instead, and a pantograph linkage for each of the 3 links instead of the prismatic joints, which need piezoelectric linear actuators to work?

    I don’t think piezo actuators are something doable by homebrew methods.

    If you read the link, everyone commenting about RC heli swashplates is right- they even claim that’s where the design idea came from.

    I would buy one of these right now if I could afford it- I can’t. I would build one if I could afford the only component I can’t make- the actuators- I can’t.

    This is a quantum leap for people like me who have immediate application for this setup, but frustrating as hell because I have no budget to pay 1000+ $ for the actuators alone, which is a lowball estimate- it’s another one of those items that no one prices on a site, it’s all custom order.

    Has anyone found the paper that describes the build of this? There is one, from a robotics conference, but I can’t find a copy anywhere.

    Is there any way this could be done with something in the hobbiest or robotics builder’s budget?

  9. Twisting the camera is necessary if you want to mimic human eyes. Look at your eye in the mirror and rotate your head about the axis of your line of sight, you will see that your eye can stay level while your head rotates about it. The range of motion is limited, but you can twist your eyes.

  10. This could be used to solve the perspective problems in 3D visualizations.

    Put your finger in front of your face. Keep looking at it, but try and pay attention to the scene behind it. It is blurry and out of focus. This gives perspective.

    Most 3D work is perfectly crisp and clear, layers painted onto each other. Being able to track what the eye is looking at, and adjusting the depth of field of the other parts of the image will be a huge leap in realistic 3D.

  11. muscle wire maybe?

    as for homemade actuators, one thought i had is to use the BaTiO3 paste in the EL kits mentioned on here to make them.

    obviously you need to use several layers and get an even coating (sellotape+parts from print head) but it should work.

  12. I have mounted a laser on a head position-er before. The thought then went to tiny camera, a simple affair of epoxy and reusing the ribbon wires. X or one dimension only. Going further, three would keep the simple rotation that is already in the sweet bearings. Direct drive center of motor to center of yoke. Much like pots on a joystick. Zed axis is the whole thing mounted on a third motor. Keep it simple. For sure, one of the best hacks for hard drive head motors. Get ‘em while they last. Solid state, no bearings no motors no magnets. All great hack food.

  13. “But twisting a camera image doesn’t have any use that I know of.”

    It would be pretty useful if the vehicle the camera is mounted to were to lean out of the horizontal for any reason — a robot moving over uneven terrain, for example. The camera could twist to keep the image level.

  14. Cute but I’m sure the video output of that camera is nothing but a colorful psychedelic blur.

    And incidentally don’t the anti-shake optics in modern cameras also move that fast? Not to mention those robot that put parts on PCB’s.

  15. @wes, I think all you need is gyro and compass mounted to the camera. Then there is no need for rotate on the camera. Just do it in software.

    Although, with compass and a gyro you could also keep the camera level with the ground.

  16. @blah yeah that was also what i was thinking, can the camera even update that fast? the movement of the “eye” is amazing, but if the camera can’t keep up then the solution is not as well rounded as i’d hoped for.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s