instant 3d design concept generation and visualization by real-time hand gesture recognition

ISCAS OpenIR

	instant 3d design concept generation and visualization by real-time hand gesture recognition
	Kang Jinsheng; Zhong Kang; Qin Shengfeng; Wang Hongan; Wright David
	2013
发表期刊	Computers in Industry
ISSN	0166-3615
卷号	64 期号:7 页码:785-797
摘要	3D conceptual design is a creative process. While the designers are in the inspirational mode, they want to quickly express the design ideas in 3D and visualize it in real time without obstacle. In an exploration of a new, natural and more user friendly interface to assist rapid 3D conceptual generation and visualization, a prototype system of hand gesture and motion capture based user interface has been proposed and implemented. In this paper, we present the framework and components of this real time 3D conceptual generation and visualization system. Hand gestures were designed with the consideration of ease to use and the suitability for real time continuous recognition. Rule-based intelligent menu/icons were designed which changes the prompts according to the design process and expected operations. Real time hand gesture recognition was realized by skeleton model based template matching, and the use of hidden Markov models (HMMs). The recognized hand gestures become command script in OpenSCAD environment, and the 3D design concept was instantly generated and displayed on the screen. A case study was conducted for the initial evaluation of the system. © 2013 Elsevier B.V. All rights reserved.; 3D conceptual design is a creative process. While the designers are in the inspirational mode, they want to quickly express the design ideas in 3D and visualize it in real time without obstacle. In an exploration of a new, natural and more user friendly interface to assist rapid 3D conceptual generation and visualization, a prototype system of hand gesture and motion capture based user interface has been proposed and implemented. In this paper, we present the framework and components of this real time 3D conceptual generation and visualization system. Hand gestures were designed with the consideration of ease to use and the suitability for real time continuous recognition. Rule-based intelligent menu/icons were designed which changes the prompts according to the design process and expected operations. Real time hand gesture recognition was realized by skeleton model based template matching, and the use of hidden Markov models (HMMs). The recognized hand gestures become command script in OpenSCAD environment, and the 3D design concept was instantly generated and displayed on the screen. A case study was conducted for the initial evaluation of the system. © 2013 Elsevier B.V. All rights reserved.
收录类别	EI
关键词	Computer Aided Design Conceptual Design Gesture Recognition Hidden Markov Models Template Matching Three Dimensional User Interfaces Visualization
部门归属	(1) School of Engineering and Design Brunel University Uxbridge Middlesex UB8 3PH United Kingdom; (2) Institute of Software Chinese Academy of Sciences Beijing 100190 China
语种	英语
WOS记录号	WOS:000324080300003
引用统计
内容类型	期刊论文
URI标识	http://ir.iscas.ac.cn/handle/311060/15668
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Kang Jinsheng,Zhong Kang,Qin Shengfeng,et al. instant 3d design concept generation and visualization by real-time hand gesture recognition[J]. Computers in Industry,2013,64(7):785-797.
APA	Kang Jinsheng,Zhong Kang,Qin Shengfeng,Wang Hongan,&Wright David.(2013).instant 3d design concept generation and visualization by real-time hand gesture recognition.Computers in Industry,64(7),785-797.
MLA	Kang Jinsheng,et al."instant 3d design concept generation and visualization by real-time hand gesture recognition".Computers in Industry 64.7(2013):785-797.