Intelligent Appearance and shape based facial emotion recognition for a humanoid robot

Kamlesh Mistry, Li Zhang, Siew Chin Neoh, Ming Jiang, Alamgir Hossain, Benoît Lafon

Research output: Contribution to conferencePaperpeer-review

Abstract

In this paper, we present an intelligent facial emotion recognition system with real-time face tracking for a humanoid robot. The system is able to detect facial actions and emotions from images with up to 60 degrees of pose variations. We employ the Active Appearance Model to perform real-time face tracking and extract both texture and geometric representations of images. A POSIT algorithm is also used to identify head rotations. The extracted texture and shape features are employed to detect 18 facial actions and seven basic emotions. The overall system is integrated with a humanoid robot platform to further extend its vision APIs. The system is proved to be able to deal with challenging facial emotion recognition tasks with various pose variations.
Original languageEnglish
DOIs
Publication statusPublished - 9 Apr 2015
Event8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA) - Dhaka
Duration: 1 Dec 2014 → …

Conference

Conference8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA)
Period1/12/14 → …

Fingerprint Dive into the research topics of 'Intelligent Appearance and shape based facial emotion recognition for a humanoid robot'. Together they form a unique fingerprint.

Cite this