Transparent desktop controlled by hands in 3D space.

Desktop interaction has taken a leap into the 3D realm after the Microsoft Applied Sciences Group demonstrated a new computing concept. A transparent Samsung OLED display allows operators to see their hands beneath a display and use them to control on-screen data using movement and gestures. A recently released video shows users moving smoothly between gesture control and a traditional keyboard/track-pad.
Jinha Lee, a PhD student at MIT Media Lab and a research intern at the Microsoft Applied Sciences Group argues that, despite advanced in 3D visualisation, desktop displays have not moved on from 2D interaction.
The new concept uses depth cameras to detect user’s fingers and captures head motion to provide the user with an appropriate perspective.