CCESK: A Chinese Character Educational System Based on Kinect

Yang Yang, Howard Leung, Hubert P. H. Shum, Jiao Li, Lanling Zeng, Nauman Aslam, Zhigeng Pan

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)


In this paper, a Chinese character educational system based on Kinect is proposed for guiding beginners to learn the basics of Chinese characters in a more intuitive way. It extracts 19 common components, denoted as alphabets, from Chinese characters. Nineteen postures were designed according to the shapes of these alphabets. Instead of memorizing Chinese characters through repetitive copying, students can first associate an alphabet with the corresponding designed posture. Then, they break down a Chinese character into a set of alphabets in order to perform the sequence of corresponding postures so that they can easily remember the whole character. Our proposed system contains two major functions: 1) the learning function that is responsible for delivering the courseware, and 2) the testing function that is used to let students acquire their learning progress through some tests. A rule-based algorithm is designed to recognize the students’ input postures captured from the Kinect motion sensor so as to determine whether the students have performed the correct postures. We conducted a survey which involved 90 students to try our proposed system as well as two other learning modes for comparison. Moreover, we have interviewed those 30 students who had tried our proposed system with some open-ended questions. The positive results show that the proposed system can promote students’ experiences in learning Chinese characters.
Original languageEnglish
Pages (from-to)342-347
JournalIEEE Transactions on Learning Technologies
Issue number3
Early online date11 Jul 2017
Publication statusPublished - 20 Sept 2018


Dive into the research topics of 'CCESK: A Chinese Character Educational System Based on Kinect'. Together they form a unique fingerprint.

Cite this