More Kinect holograms from [programming4fun]

[programing4fun] has been playing around with his Kinect-based 3D display and building a holographic WALL-E controllable with a Windows phone. It’s a ‘kid safe’ version of his Terminator personal assistant that has voice control and support for 3d anaglyph and shutter glasses.

When we saw [programming4fun]‘s Kinect hologram setup last summer we were blown away. By tracking a user’s head with a Kinect, [programming] was able to display a 3D image using only a projector. This build was adapted into a 3D multitouch table and real life portals, so we’re glad to see [programming4fun] refining his code and coming up with some really neat builds.

In addition to robotic avatars catering to your every wish, [programming4fun] also put together a rudimentary helicopter flight simulator controlled by tilting cell phone. It’s the same DirectX 9 heli from [programming]‘s original build. with the addition of Desert Strike-esque top-down graphics. This might be the future of gaming here, so we’ll keep our eyes out for similar head-tracking 3D builds.

As always, videos after the break.




Comments

  1. MrX says:

    Stop calling this “holograms”. This is nowhere the definition of a “hologram”. If the editors were Hollywood people, then I would let it pass but this is a hacker’s space for the god’s sake!

    http://en.wikipedia.org/wiki/Holography

    For you to have an hologram, you need a medium were you can record and then fully reconstruct a wavefront.

    So please, next time you call something an “hologram” please make sure it actually matches its definition.

    • nah! says:

      this is more like head tracking and correcting perspective accordingly right
      ?

      • MrX says:

        The correct term is freeview 3D. But yes, it ends up being a 3D projection into a 2D plane with an active system (kinect) for perspective correction. You can even have more than 1 projection to create more views for stereoscopic and multiview displays.

        A hologram is this:

        In that video, the recording medium is just a photosensitive glass which when illuminated, it fully modelates the incident light such that the light scattered (reflected) from the glass surface 100% “imitates/clones” the light that would be scattered from the real (recorded) object.
        In other words, there is no optical difference between the light scattered from an hologram and a real world object.

        In that video you can see that the world geometry (physical dimensions) is preserved. You can also see that you have full horizontal and vertical parallax (the perspective changes when you tilt your head in all directions). Also, and really important cause stereoscopic 3D cannot do this, is that your eyes can actually focus the virtual (reconstructed) object. If seek the video to around 1:04, you can see that by putting the camera (or your eye pupil) in the virtual lens of the virtual microscope, you can actually see the zoomed mosquito that was below the real microscope objective at the time the hologram was recorded.
        This is what makes holograms so cool.

  2. asdf says:

    What happens when there’s more than one head in the room?

    • SAC_Rob says:

      I would imagine only the person being tracked would get the 3d experience. The other would get a shifting 2d view as the person being tracked moves around. Unless you were able to sync your movements exactly like the person being tracked.

    • SAC_Rob says:

      My question is where is he keeping the Kinect? Is it behind the user?? or up high on the wall??

      • SAC_Rob says:

        Never mind he shows the setup at 2:22 on the wall-e video.

        Is it really required to have a 3d-tv?? i would think this effect would be possible any tv.

    • Isaac says:

      A great solution to this is using a 3Dtv with 2 of the same lense, i.e.

      Basically enables 2 users (or more once they get 180hz/240hz TVs) if both are being tracked by the kinect to see different images.

      I honestly think 2 player fullscreen is going to take off if 3D tv makers finally decide to use the same protocol for glasses (and ideally, it’s passive).

  3. asdf says:

    Not trying to sound like a dick. I just want to make sure I understand. Please correct me if I’m wrong.

    1. It only works for one person in the room. Similar to Johnny Chung Lee’s Wii project.
    2. The focal point (when using 3D) depends on the media and not your eyes. Like all 3D TVs and movies.
    i.e. it’s fuzzy if you’re not looking where you are supposed to.
    3. The kinect tracks your head from 10 feet behind. Is it possible for the kinect to be mounted by the TV and would it operate in a dark environment like a theater?

    • GTMoogle says:

      1. Yup. There are some fancy setups that can do 2 person 3d by using a 240 hz TV, 60 hz for each of the 4 eyes of two people, not sure how available these are, but in theory it’s possible. But as far as commonly available stuff, yes, one person. It’s not a hologram, which works for all points in space viewing it.

      2. Well, the focal point is the distance of the screen, the camera’s focus is what the camera is focused on. A computer generated image can have everything in focus (simulating a pinhole camera), at the expense of a little 3d realism.

      3. Yes. The kinect uses IR and needs no visible light, and the location of it is pretty arbitrary and just needs to be accounted for in software. Not sure why he put it behind in the first place.

  4. dreamer says:

    Too bad our iBeamer project was never mentioned.
    Afaik it’s the only ‘fully immersive’ project like this.

    [YouTube=http://www.youtube.com/watch?v=srSDJifMtWg]

  5. adam says:

    Is the code available anywhere? (didn’t find it, but maybe I just missed it)

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 97,759 other followers