Body Synthesizer

Among his final projects for last semester, Kuan Huang, an NYU's ITP student, has created Virtual Instrument and Body Synthesizer.

A camera captures the movement of the "player"'s hands and head. Those movements are processed by the computer and converted to some signals which are turned into different sounds. So it looks like he is playing some virtual instruments, like the piano or the drum.

Video.

Huang is one of the designers of the Club Robot.