An N-of-1 Evaluation Framework for Behaviour Change Applications

Claire McCallum, John Rooksby, Parvin Asadzadeh Birjandi, Cindy M. Gray, Matthew Chalmers

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)
19 Downloads (Pure)

Abstract

Mobile behaviour change applications should be evaluated for their effectiveness in promoting the intended behavior changes. In this paper we argue that the 'gold standard' form of effectiveness evaluation, the randomised controlled trial, has shortcomings when applied to mobile applications. We propose that N-of-1 (also known as single case design) based approaches have advantages. There is currently a lack of guidance for researchers and developers on how to take this approach. We present a framework encompassing three phases and two related checklists for performing N-of-1 evaluations. We also present our analysis of using this framework in the development and deployment of an app that encourages people to walk more. Our key findings are that there are challenges in designing engaging apps that automate N-of-1 procedures, and that there are challenges in collecting sufficient data of good quality. Further research should address these challenges.
Original languageEnglish
Title of host publicationCHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
Subtitle of host publicationGlasgow, Scotland Uk — May 04 - 09, 2019
Place of PublicationNew York
PublisherACM
Number of pages6
ISBN (Electronic)9781450359719
DOIs
Publication statusPublished - 2 May 2019
EventACM CHI Conference on Human Factors in Computing Systems 2019: CHI’19 Workshop: HCI in China: Research Agenda, Education Curriculum, Industry Partnership, and Communities Building - Scottish Event Campus, Glasgow, United Kingdom
Duration: 4 May 20199 May 2019
https://chi2019.acm.org/
http://chi2019.acm.org

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

ConferenceACM CHI Conference on Human Factors in Computing Systems 2019
Abbreviated titleCHI 2019
CountryUnited Kingdom
CityGlasgow
Period4/05/199/05/19
Internet address

Fingerprint

Dive into the research topics of 'An N-of-1 Evaluation Framework for Behaviour Change Applications'. Together they form a unique fingerprint.

Cite this