[Johhny chung Lee], eat your heart out. Check out what these guys are doing with face tracking and immersive 3d as their final project in class. They’re using a singe camera and an FPGA to produce the demo you see in the video. Facial tracking is done by skin color, so that might have some issues in some environments, but being able to have perspective shift with you, without rigging up some more hardware is fantastic.
We realize that this is completely different that what [Johnny] is doing. We love [Johnny]‘s work and think it is ground breaking to be able to pull this stuff off with a cheap game controller. We just couldn’t help but draw the parallel from the end result.