I guess it'll work a lot like a Kinect, just much more finely calibrated. You'll probably need to gently 'tap' an object to chose it, in order to manipulate it the way you want. If it's still screens, just transparent (as most of the screens on the helicarrier for example seem to be), it'll be even easier.