VRitual AV Tactile Micro Interface: VRitual AV 404 Mexico City

Continuing the motion-based work of Opto-Phono-Kinesia I have developed VRitual AV. In response to the limitations introduced by the COVID-19 pandemic, I utilised a more portable and simpler interface than the room-scale Gesture and Media System motion-tracking system used in the above project.

VRitual AV uses the Leap Motion 3D controller, as well as a multi-touch iPad interface (in TouchOSC) to enable small-area gestural control of sound, visuals and light. It deliberately uses as few technological resources as possible in a limited spatial area, while retaining the complexity of interaction required for an expert (as opposed to a general) interactive performance. The project builds on previous work on multi-modal synesthetic interfaces.

In short, the gestural or touch-based actions have matched audio and light response that are both repeatable and logical (i.e., raised hand to audio volume, video opacity and light dimmer), while at the same time the number of gestural interactions is substantive enough to make the interface complex enough for a genuinely satisfying performance by an expert performer. VRitual AV enables the performer to move his or her hands and draw to perform and mix music, lights and visuals in real-time with precision. The ultimate in tactile audio-visual interfaces!