TY - GEN
T1 - Visual cues effect on the impact of sonification on movement
AU - Newbold, Joseph W.
AU - Bianchi-Berthouze, Nadia
AU - Gold, Nicolas E.
PY - 2018/6/28
Y1 - 2018/6/28
N2 - When designing movement sonification, its effect on peoples' movement must be considered. Recent work has shown that using musical expectancy within movement sonification can impact the way people move. However, this body of work has also found that different types of movements show different effects of these musically-informed sonifications on movement behaviour. This paper addresses this disparity, by exploring how this kind of sonification may be impacted by perceptual cues. We focus on two kinds of target movements: an "open movement", i.e. One with limited perceptual cues (no visual cues from the environment and limited proprioceptive cues) at a target point, and a "closed movement" i.e. One with strong perceptual (visual and proprioceptive) cues at the target point. We present a study that investigates how visual cues may interact with musical expectancy based sonification and discuss what these results mean for musical expectancy based designs andmusically-informed sonification overall We show that the effect of expectancy of sonification at a target point is greater when visual cues are removed.
AB - When designing movement sonification, its effect on peoples' movement must be considered. Recent work has shown that using musical expectancy within movement sonification can impact the way people move. However, this body of work has also found that different types of movements show different effects of these musically-informed sonifications on movement behaviour. This paper addresses this disparity, by exploring how this kind of sonification may be impacted by perceptual cues. We focus on two kinds of target movements: an "open movement", i.e. One with limited perceptual cues (no visual cues from the environment and limited proprioceptive cues) at a target point, and a "closed movement" i.e. One with strong perceptual (visual and proprioceptive) cues at the target point. We present a study that investigates how visual cues may interact with musical expectancy based sonification and discuss what these results mean for musical expectancy based designs andmusically-informed sonification overall We show that the effect of expectancy of sonification at a target point is greater when visual cues are removed.
KW - Movement behaviour
KW - Movement sonification
KW - Physical activity.
KW - Sonification design
UR - http://www.scopus.com/inward/record.url?scp=85055347630&partnerID=8YFLogxK
U2 - 10.1145/3212721.3212880
DO - 10.1145/3212721.3212880
M3 - Conference contribution
AN - SCOPUS:85055347630
T3 - ACM International Conference Proceeding Series
BT - Proceedings of the 5th International Conference on Movement and Computing, MOCO 2018
PB - Association for Computing Machinery, Inc
T2 - 5th International Conference on Movement and Computing, MOCO 2018
Y2 - 28 June 2018 through 30 June 2018
ER -