Interactive Video Mapping – Processing x Live Orchestra

These generative Java sketches were developed using Processing as part of a live video mapping performance in collaboration with a classical orchestra.
The system captures real-time input from infrared cameras and microphones to track both the conductor's gestures and the musical dynamics of the ensemble.
This data is processed and transmitted via OSC protocol to Resolume Arena, enabling a fluid audiovisual dialogue between movement, sound, and projection.
The result is a performance where visuals are not just reactive, but deeply integrated with the emotional flow of the music and human expression.