Using motion-tracking for total control of media by expert users

Description of impact

• This project continues the work of my REF2014 ICS, “Virtual VJ: Enabling Engagement Through Audio-Visual Performance.”
• The project continues my work at Lead Beta-tester of the Gesture and Media System, now in its third iteration as GAMS 3.0. Northumbria has one of two of these systems in existence.
• The Case Study involves collaboration with Northern Dance (supported by a Creativity Works grant) to create a performance entitled Ephemera, in which all aspects are controlled by the motions of a Royal Ballet trained dancer, Maxine Fell. In addition, I have created a solo performance Opto-Phono-Kinesia (OPK), which has been performed at a major international venue. In essence my work with Northern Dance has enabled them to create an entirely new form of dance.
• The impact will be documented by reports from the venue organisers, the dancer herself, Northern Dance as a new arts and technology organisation, as well as the company making the GAMS tracking system, APR Inc./Moment Research.
• The impact will include documented commercial impact (as in sales of new GAMS 3.0 systems), the artistic impact of working with the system by the dancer, as well as the cultural impact on the venues and the audiences.

The impact will include documented commercial impact (as in sales of new GAMS systems, as well as the commercial and cultural impact on Northern Dance), the artistic impact of working with the system by the dancer, as well as the cultural impact on the venues and the audiences. This project will explore how motion-tracking and live Audio, Lighting and Visual FX technologies can respond to the expressive requirements of work employing dancers, artists and musicians as well as in a staged situation or controlled environments. The key innovation will lie in the enabling of total control of an immersive mixed-media environment by body movement through the use of a proprietary motion-tracking system.

Northern Dance, and its parent company Paper Dove Company, will lead a collaborative team combining art, technology and movement, to create a project Ephemera that showcase this motion-based system. This is being developed at Northumbria and at Northern Dance’s new renovated space in the Ouseburn. David Leonard the key driver and principal owner of the project leading company Paper Dove and is collaborating on the music for this project. Mike Chilton, is the key artist developing the artistic design of the project. Royal Ballet trained dancer Maxine Fell will control all of the media with her movement. Steve Gibson is creating the interactive mapping for control of the media by the dancer, and collaborating on the music. Paul Goodfellow is developing the Live Visual interaction. The piece is being proposed to high-profile venues such as the Sage and therefore will have demonstrable and substantial potential impact.

The timeline for completion of the Ephemera project is by January 2019. It is anticipated that there will be several performances at this point. The most promising venue is the SAGE (discussions have taken place, this is yet to be confirmed). Opto-Phono Kinesia is now complete and has been performed once and will be proposed to further venues.

Category of impact	Creativity, culture and society, Economic, commercial and technological