Telekinesis is an interactive performance system comprising an FM synthesizer, a polyphonic sample player, a chord/drone generator and a few sound processing units realized in Max, an iPad, and a Microsoft Kinect sensor tracking upper body movement of the user.
The movement data gathered from the head, torso, and joints such as wrist and elbow are mapped to various parameters of the FM synthesizer and the sound processing units. The user movement is also used for triggering audio samples, controlling playback-related parameters, and change the character of the chords generated. The iPad application gives the users control over the intensity of the sound generators and processors and includes a utility section to save and load presets effortlessly.
This system uses Synapse for Kinect application and Max external to communicate with the Microsoft Kinect sensor.