TY - JOUR
T1 - Instant 3D design concept generation and visualization by real-time hand gesture recognition
AU - Kang, Jinsheng
AU - Zhong, Kang
AU - Qin, Sheng-feng
AU - Wang, Hongan
AU - Wright, David
PY - 2013/9
Y1 - 2013/9
N2 - 3D conceptual design is a creative process. While the designers are in the inspirational mode, they want to quickly express the design ideas in 3D and visualize it in real time without obstacle. In an exploration of a new, natural and more user friendly interface to assist rapid 3D conceptual generation and visualization, a prototype system of hand gesture and motion capture based user interface has been proposed and implemented. In this paper, we present the framework and components of this real time 3D conceptual generation and visualization system. Hand gestures were designed with the consideration of ease to use and the suitability for real time continuous recognition. Rule-based intelligent menu/icons were designed which changes the prompts according to the design process and expected operations. Real time hand gesture recognition was realized by skeleton model based template matching, and the use of hidden Markov models (HMMs). The recognized hand gestures become command script in OpenSCAD environment, and the 3D design concept was instantly generated and displayed on the screen. A case study was conducted for the initial evaluation of the system.
AB - 3D conceptual design is a creative process. While the designers are in the inspirational mode, they want to quickly express the design ideas in 3D and visualize it in real time without obstacle. In an exploration of a new, natural and more user friendly interface to assist rapid 3D conceptual generation and visualization, a prototype system of hand gesture and motion capture based user interface has been proposed and implemented. In this paper, we present the framework and components of this real time 3D conceptual generation and visualization system. Hand gestures were designed with the consideration of ease to use and the suitability for real time continuous recognition. Rule-based intelligent menu/icons were designed which changes the prompts according to the design process and expected operations. Real time hand gesture recognition was realized by skeleton model based template matching, and the use of hidden Markov models (HMMs). The recognized hand gestures become command script in OpenSCAD environment, and the 3D design concept was instantly generated and displayed on the screen. A case study was conducted for the initial evaluation of the system.
KW - 3D conceptual design
KW - hand gesture
KW - motion capture
KW - computer aided design
KW - concept generation and visualization
U2 - 10.1016/j.compind.2013.04.012
DO - 10.1016/j.compind.2013.04.012
M3 - Article
VL - 64
SP - 785
EP - 797
JO - Computers in Industry
JF - Computers in Industry
SN - 0166-3615
IS - 7
ER -