Title: phoneme-level articulatory animation in pronunciation training
Author: Wang Lan
; Chen Hui
; Li Sheng
; Meng Helen M.
Source: Speech Communication
Issued Date: 2012
Volume: 54, Issue: 7, Pages: 845-856 Indexed Type: ei
Department: (1) Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, China; (2) Chinese University of HongKong, China; (3) Institute of Software, Chinese Academy of Sciences, China
English Abstract: Speech visualization is extended to use animated talking heads for computer assisted pronunciation training. In this paper, we design a data-driven 3D talking head system for articulatory animations with synthesized articulator dynamics at the phoneme level. A database of AG500 EMA-recordings of three-dimensional articulatory movements is proposed to explore the distinctions of producing the sounds. Visual synthesis methods are then investigated, including a phoneme-based articulatory model with a modified blending method. A commonly used HMM-based synthesis is also performed with a Maximum Likelihood Parameter Generation algorithm for smoothing. The 3D articulators are then controlled by synthesized articulatory movements, to illustrate both internal and external motions. Experimental results have shown the performances of visual synthesis methods by root mean square errors. A perception test is then presented to evaluate the 3D animations, where a word identification accuracy is 91.6% among 286 tests, and an average realism score is 3.5 (1 = bad to 5 = excellent). © 2012 Elsevier B.V. All rights reserved. Language: 英语
WOS ID: WOS:000305496400001
Citation statistics:
Content Type: 期刊论文
URI: http://ir.iscas.ac.cn/handle/311060/14731
Appears in Collections: 软件所图书馆_期刊论文
File Name/ File Size
Content Type
Version
Access
License
1-s2.0-S0167639312000180-main.pdf （1311KB） -- -- 限制开放 联系获取全文
Recommended Citation:
Wang Lan,Chen Hui,Li Sheng,et al. phoneme-level articulatory animation in pronunciation training[J]. Speech Communication,2012-01-01,54(7):845-856.
