Gesture recognition for humanoid assisted interactive sign language tutoring

Translated title of the contribution: Insansi robot destekli interaktif isaret dili egitimi için isaret tanima

Bekir Sitki Ertugrul, Cemal Gurpinar, Hasan Kivrak, Hatice Kose

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

17 Citations (Scopus)

Abstract

This work is part of an ongoing work for sign language tutoring with imitation based turn-taking and interaction games (iSign) with humanoid robots and children with communication impairments. The paper focuses on the extension of the game, mainly for children with autism. Autism Spektrum Disorder (ASD) involves communication impairments, limited social interaction, and limited imagination. Many such children show interest in robots and find them engaging. Robots can facilitate social interaction between the child and teacher. In this work, a Nao H25 Humanoid robot assisted the human teacher to teach some signs and basic upper torso actions which were observed and imitated by the participants. Kinect camera based system was used to recognize the signs and other actions, and the robot gave visual and audial feedback to the participants based on the performance.

Translated title of the contributionInsansi robot destekli interaktif isaret dili egitimi için isaret tanima
Original languageTurkish
Title of host publication2013 21st Signal Processing and Communications Applications Conference, SIU 2013
DOIs
Publication statusPublished - 2013
Externally publishedYes
Event2013 21st Signal Processing and Communications Applications Conference, SIU 2013 - Haspolat, Turkey
Duration: 24 Apr 201326 Apr 2013

Publication series

Name2013 21st Signal Processing and Communications Applications Conference, SIU 2013

Conference

Conference2013 21st Signal Processing and Communications Applications Conference, SIU 2013
Country/TerritoryTurkey
CityHaspolat
Period24/04/1326/04/13

Keywords

  • Autism
  • Human-robot interaction
  • Imitation games
  • Sign language

Cite this