IntraVox: A Personalized Human Voice to Support Users with Complex Needs in Smart Homes

Ana-Maria Salai; Glenda Cook; Lars Erik Holmquist

doi:10.1007/978-3-030-85623-6_15

IntraVox: A Personalized Human Voice to Support Users with Complex Needs in Smart Homes

Ana-Maria Salai^*, Glenda Cook, Lars Erik Holmquist

^*Corresponding author for this work

Nursing Midwifery and Health Department

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Citations (Scopus)

15 Downloads (Pure)

Abstract

We present IntraVox, a novel voice-based interaction system that supports users with complex needs by introducing a highly personalized, human voice command between smart home devices and sensors. Voice-enabled personal assistants (e.g., Amazon Alexa, Google Home) can be used to control smart home devices and increase the quality of life. However, people suffering from conditions such as dementia or learning disabilities and autism (LDA) can encounter verbal and memory problems in communicating with the assistants. IntraVox supports these users by verbally sending smart home control commands, based on the sensor data collected, to a voice-enabled personal assistant using a human voice. Over 12 months, we conducted 7 workshops and 9 interviews with 79 participants from multiple stakeholder categories - people with LDA, older and frail people, social and health care organisations. Results show that our solution has the potential to support people with complex needs and increase independence. Moreover, IntraVox could have the added value of reinforcing the learning of specific commands and making visible the inner workings of a home automation system, by giving users a clear cause-and-effect explanation of why certain events occur.

Original language	English
Title of host publication	Human-Computer Interaction – INTERACT 2021
Subtitle of host publication	18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part I
Editors	Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, Kori Inkpen
Place of Publication	Cham
Publisher	Springer
Chapter	15
Pages	223-244
Number of pages	22
Volume	12932
ISBN (Electronic)	9783030856236
ISBN (Print)	9783030856229
DOIs	https://doi.org/10.1007/978-3-030-85623-6_15
Publication status	Published - 2021
Event	18th IFIP TC13 International Conference on Human–Computer Interaction: Sense, Feel, Design - Bari, Italy Duration: 30 Aug 2021 → 3 Sept 2021 https://www.interact2021.org/

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	12932
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	18th IFIP TC13 International Conference on Human–Computer Interaction
Abbreviated title	INTERACT 2021
Country/Territory	Italy
City	Bari
Period	30/08/21 → 3/09/21
Internet address	https://www.interact2021.org/

Keywords

Home automation
Smart homes
Virtual assistants

Access to Document

10.1007/978-3-030-85623-6_15

interact21a-sub1165-cam-i7 copyAccepted author manuscript, 429 KB

Cite this

Salai, A.-M., Cook, G., & Holmquist, L. E. (2021). IntraVox: A Personalized Human Voice to Support Users with Complex Needs in Smart Homes. In C. Ardito, R. Lanzilotti, A. Malizia, H. Petrie, A. Piccinno, G. Desolda, & K. Inkpen (Eds.), Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part I (Vol. 12932, pp. 223-244). (Lecture Notes in Computer Science; Vol. 12932). Springer. https://doi.org/10.1007/978-3-030-85623-6_15

Salai, Ana-Maria ; Cook, Glenda ; Holmquist, Lars Erik. / IntraVox : A Personalized Human Voice to Support Users with Complex Needs in Smart Homes. Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part I. editor / Carmelo Ardito ; Rosa Lanzilotti ; Alessio Malizia ; Helen Petrie ; Antonio Piccinno ; Giuseppe Desolda ; Kori Inkpen. Vol. 12932 Cham : Springer, 2021. pp. 223-244 (Lecture Notes in Computer Science).

@inproceedings{54c7eac3654b47129cb990f08d8f6fd8,

title = "IntraVox: A Personalized Human Voice to Support Users with Complex Needs in Smart Homes",

abstract = "We present IntraVox, a novel voice-based interaction system that supports users with complex needs by introducing a highly personalized, human voice command between smart home devices and sensors. Voice-enabled personal assistants (e.g., Amazon Alexa, Google Home) can be used to control smart home devices and increase the quality of life. However, people suffering from conditions such as dementia or learning disabilities and autism (LDA) can encounter verbal and memory problems in communicating with the assistants. IntraVox supports these users by verbally sending smart home control commands, based on the sensor data collected, to a voice-enabled personal assistant using a human voice. Over 12 months, we conducted 7 workshops and 9 interviews with 79 participants from multiple stakeholder categories - people with LDA, older and frail people, social and health care organisations. Results show that our solution has the potential to support people with complex needs and increase independence. Moreover, IntraVox could have the added value of reinforcing the learning of specific commands and making visible the inner workings of a home automation system, by giving users a clear cause-and-effect explanation of why certain events occur.",

keywords = "Home automation, Smart homes, Virtual assistants",

author = "Ana-Maria Salai and Glenda Cook and Holmquist, {Lars Erik}",

year = "2021",

doi = "10.1007/978-3-030-85623-6_15",

language = "English",

isbn = "9783030856229",

volume = "12932",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "223--244",

editor = "Carmelo Ardito and Rosa Lanzilotti and Alessio Malizia and Helen Petrie and Antonio Piccinno and Giuseppe Desolda and Kori Inkpen",

booktitle = "Human-Computer Interaction – INTERACT 2021",

address = "Germany",

note = "18th IFIP TC13 International Conference on Human–Computer Interaction : Sense, Feel, Design, INTERACT 2021 ; Conference date: 30-08-2021 Through 03-09-2021",

url = "https://www.interact2021.org/",

}

Salai, A-M, Cook, G & Holmquist, LE 2021, IntraVox: A Personalized Human Voice to Support Users with Complex Needs in Smart Homes. in C Ardito, R Lanzilotti, A Malizia, H Petrie, A Piccinno, G Desolda & K Inkpen (eds), Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part I. vol. 12932, Lecture Notes in Computer Science, vol. 12932, Springer, Cham, pp. 223-244, 18th IFIP TC13 International Conference on Human–Computer Interaction, Bari, Italy, 30/08/21. https://doi.org/10.1007/978-3-030-85623-6_15

IntraVox: A Personalized Human Voice to Support Users with Complex Needs in Smart Homes. / Salai, Ana-Maria; Cook, Glenda; Holmquist, Lars Erik.
Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part I. ed. / Carmelo Ardito; Rosa Lanzilotti; Alessio Malizia; Helen Petrie; Antonio Piccinno; Giuseppe Desolda; Kori Inkpen. Vol. 12932 Cham: Springer, 2021. p. 223-244 (Lecture Notes in Computer Science; Vol. 12932).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - IntraVox

T2 - 18th IFIP TC13 International Conference on Human–Computer Interaction

AU - Salai, Ana-Maria

AU - Cook, Glenda

AU - Holmquist, Lars Erik

PY - 2021

Y1 - 2021

N2 - We present IntraVox, a novel voice-based interaction system that supports users with complex needs by introducing a highly personalized, human voice command between smart home devices and sensors. Voice-enabled personal assistants (e.g., Amazon Alexa, Google Home) can be used to control smart home devices and increase the quality of life. However, people suffering from conditions such as dementia or learning disabilities and autism (LDA) can encounter verbal and memory problems in communicating with the assistants. IntraVox supports these users by verbally sending smart home control commands, based on the sensor data collected, to a voice-enabled personal assistant using a human voice. Over 12 months, we conducted 7 workshops and 9 interviews with 79 participants from multiple stakeholder categories - people with LDA, older and frail people, social and health care organisations. Results show that our solution has the potential to support people with complex needs and increase independence. Moreover, IntraVox could have the added value of reinforcing the learning of specific commands and making visible the inner workings of a home automation system, by giving users a clear cause-and-effect explanation of why certain events occur.

AB - We present IntraVox, a novel voice-based interaction system that supports users with complex needs by introducing a highly personalized, human voice command between smart home devices and sensors. Voice-enabled personal assistants (e.g., Amazon Alexa, Google Home) can be used to control smart home devices and increase the quality of life. However, people suffering from conditions such as dementia or learning disabilities and autism (LDA) can encounter verbal and memory problems in communicating with the assistants. IntraVox supports these users by verbally sending smart home control commands, based on the sensor data collected, to a voice-enabled personal assistant using a human voice. Over 12 months, we conducted 7 workshops and 9 interviews with 79 participants from multiple stakeholder categories - people with LDA, older and frail people, social and health care organisations. Results show that our solution has the potential to support people with complex needs and increase independence. Moreover, IntraVox could have the added value of reinforcing the learning of specific commands and making visible the inner workings of a home automation system, by giving users a clear cause-and-effect explanation of why certain events occur.

KW - Home automation

KW - Smart homes

KW - Virtual assistants

UR - http://www.scopus.com/inward/record.url?scp=85115069336&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-85623-6_15

DO - 10.1007/978-3-030-85623-6_15

M3 - Conference contribution

SN - 9783030856229

VL - 12932

T3 - Lecture Notes in Computer Science

SP - 223

EP - 244

BT - Human-Computer Interaction – INTERACT 2021

A2 - Ardito, Carmelo

A2 - Lanzilotti, Rosa

A2 - Malizia, Alessio

A2 - Petrie, Helen

A2 - Piccinno, Antonio

A2 - Desolda, Giuseppe

A2 - Inkpen, Kori

PB - Springer

CY - Cham

Y2 - 30 August 2021 through 3 September 2021

ER -

Salai AM, Cook G, Holmquist LE. IntraVox: A Personalized Human Voice to Support Users with Complex Needs in Smart Homes. In Ardito C, Lanzilotti R, Malizia A, Petrie H, Piccinno A, Desolda G, Inkpen K, editors, Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part I. Vol. 12932. Cham: Springer. 2021. p. 223-244. (Lecture Notes in Computer Science). Epub 2021 Aug 26. doi: 10.1007/978-3-030-85623-6_15

IntraVox: A Personalized Human Voice to Support Users with Complex Needs in Smart Homes

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this