TY - GEN
T1 - Gesture recognition for humanoid assisted interactive sign language tutoring
AU - Ertugrul, Bekir Sitki
AU - Gurpinar, Cemal
AU - Kivrak, Hasan
AU - Kose, Hatice
PY - 2013
Y1 - 2013
N2 - This work is part of an ongoing work for sign language tutoring with imitation based turn-taking and interaction games (iSign) with humanoid robots and children with communication impairments. The paper focuses on the extension of the game, mainly for children with autism. Autism Spektrum Disorder (ASD) involves communication impairments, limited social interaction, and limited imagination. Many such children show interest in robots and find them engaging. Robots can facilitate social interaction between the child and teacher. In this work, a Nao H25 Humanoid robot assisted the human teacher to teach some signs and basic upper torso actions which were observed and imitated by the participants. Kinect camera based system was used to recognize the signs and other actions, and the robot gave visual and audial feedback to the participants based on the performance.
AB - This work is part of an ongoing work for sign language tutoring with imitation based turn-taking and interaction games (iSign) with humanoid robots and children with communication impairments. The paper focuses on the extension of the game, mainly for children with autism. Autism Spektrum Disorder (ASD) involves communication impairments, limited social interaction, and limited imagination. Many such children show interest in robots and find them engaging. Robots can facilitate social interaction between the child and teacher. In this work, a Nao H25 Humanoid robot assisted the human teacher to teach some signs and basic upper torso actions which were observed and imitated by the participants. Kinect camera based system was used to recognize the signs and other actions, and the robot gave visual and audial feedback to the participants based on the performance.
KW - Autism
KW - Human-robot interaction
KW - Imitation games
KW - Sign language
UR - http://www.scopus.com/inward/record.url?scp=84880885046&partnerID=8YFLogxK
U2 - 10.1109/SIU.2013.6531542
DO - 10.1109/SIU.2013.6531542
M3 - Conference contribution
AN - SCOPUS:84880885046
SN - 9781467355629
T3 - 2013 21st Signal Processing and Communications Applications Conference, SIU 2013
BT - 2013 21st Signal Processing and Communications Applications Conference, SIU 2013
T2 - 2013 21st Signal Processing and Communications Applications Conference, SIU 2013
Y2 - 24 April 2013 through 26 April 2013
ER -