TY - JOUR
T1 - A data-driven robotic Chinese calligraphy system using convolutional auto-encoder and differential evolution
AU - Gao, Xingen
AU - Zhou, Changle
AU - Chao, Fei
AU - Yang, Longzhi
AU - Lin, Chih Min
AU - Xu, Tao
AU - Shang, Changjing
AU - Shen, Qiang
PY - 2019/10/15
Y1 - 2019/10/15
N2 - The Chinese stroke evaluation and generation systems required in an autonomous calligraphy robot play a crucial role in producing high-quality writing results with good diversity. These systems often suffer from inefficiency and non-optima despite of intensive research effort investment by the robotic community. This paper proposes a new learning system to allow a robot to automatically learn to write Chinese calligraphy effectively. In the proposed system, the writing quality evaluation subsystem assesses written strokes using a convolutional auto-encoder network (CAE), which enables the generation of aesthetic strokes with various writing styles. The trained CAE network effectively excludes poorly written strokes through stroke reconstruction, but guarantees the inheritance of information from well-written ones. With the support of the evaluation subsystem, the writing trajectory model generation subsystem is realized by multivariate normal distributions optimized by differential evolution (DE), a type of heuristic optimization search algorithm. The proposed approach was validated and evaluated using a dataset of nine stroke categories; high-quality written strokes have been resulted with good diversity which shows the robustness and efficacy of the proposed approach and its potential in autonomous action-state space exploration for other real-world applications.
AB - The Chinese stroke evaluation and generation systems required in an autonomous calligraphy robot play a crucial role in producing high-quality writing results with good diversity. These systems often suffer from inefficiency and non-optima despite of intensive research effort investment by the robotic community. This paper proposes a new learning system to allow a robot to automatically learn to write Chinese calligraphy effectively. In the proposed system, the writing quality evaluation subsystem assesses written strokes using a convolutional auto-encoder network (CAE), which enables the generation of aesthetic strokes with various writing styles. The trained CAE network effectively excludes poorly written strokes through stroke reconstruction, but guarantees the inheritance of information from well-written ones. With the support of the evaluation subsystem, the writing trajectory model generation subsystem is realized by multivariate normal distributions optimized by differential evolution (DE), a type of heuristic optimization search algorithm. The proposed approach was validated and evaluated using a dataset of nine stroke categories; high-quality written strokes have been resulted with good diversity which shows the robustness and efficacy of the proposed approach and its potential in autonomous action-state space exploration for other real-world applications.
KW - Convolutional auto-encoder
KW - Data-driven evaluation model
KW - Differential evolution
KW - Robotic Chinese calligraphy
U2 - 10.1016/j.knosys.2019.06.010
DO - 10.1016/j.knosys.2019.06.010
M3 - Article
AN - SCOPUS:85067489453
SN - 0950-7051
VL - 182
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
M1 - 104802
ER -