Creating an interesting experience using sensors to control image and sound in a performance isn’t the easiest thing to do. You don’t want it to look like Mickey Mouse, and you still want the interaction between the performer and the sound/visuals to be clearly visible.
Oscillare, a project by a group called Electronic Performers is an interesting attempt to use a dancers’ movement to control sound and visuals without becoming too cheesy. The movements are analysed using accelerometers and gyroscopes, and Max/MSP/Jitter software is used to process the incoming data. The sounds we hear come from an Access Virus TI synthesizer.
You can see this interactive multimedia performance at the Sonar festival, which starts today.