Visual cues effect on the impact of sonification on movement

Joseph W. Newbold, Nadia Bianchi-Berthouze, Nicolas E. Gold

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)


When designing movement sonification, its effect on peoples' movement must be considered. Recent work has shown that using musical expectancy within movement sonification can impact the way people move. However, this body of work has also found that different types of movements show different effects of these musically-informed sonifications on movement behaviour. This paper addresses this disparity, by exploring how this kind of sonification may be impacted by perceptual cues. We focus on two kinds of target movements: an "open movement", i.e. One with limited perceptual cues (no visual cues from the environment and limited proprioceptive cues) at a target point, and a "closed movement" i.e. One with strong perceptual (visual and proprioceptive) cues at the target point. We present a study that investigates how visual cues may interact with musical expectancy based sonification and discuss what these results mean for musical expectancy based designs andmusically-informed sonification overall We show that the effect of expectancy of sonification at a target point is greater when visual cues are removed.

Original languageEnglish
Title of host publicationProceedings of the 5th International Conference on Movement and Computing, MOCO 2018
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450365048
Publication statusPublished - 28 Jun 2018
Externally publishedYes
Event5th International Conference on Movement and Computing, MOCO 2018 - Genoa, Italy
Duration: 28 Jun 201830 Jun 2018

Publication series

NameACM International Conference Proceeding Series


Conference5th International Conference on Movement and Computing, MOCO 2018

Cite this