中国科学院软件研究所机构知识库
Advanced  
ISCAS OpenIR  > 中科院软件所  > 中科院软件所
题名:
基于笔和语音的多通道儿童讲故事系统
作者: 张婕
答辩日期: 2007-06-07
授予单位: 中国科学院软件研究所
授予地点: 软件研究所
学位: 博士
关键词: 儿童讲故事 ; 多通道交互 ; 多通道语义融合 ; 上下文 ; 以用户为中心的设计 ; 界面场景 ; 可用性评估
其他题名: A Speech- and Pen-based Multimodal Storytelling System for Children
摘要: 随着计算机的普及,越来越多的儿童开始使用计算机。无论是在课堂还是在家里,他们利用计算机玩游戏、学习知识,计算机正在逐渐改变儿童的生活、学习方式。讲故事在儿童的成长过程中也具有重要的作用,通过讲故事可以使儿童了解周围世界、认识自我、并融入文化。然而,传统的鼠标、键盘的交互方式并不适合儿童使用,并且两者的切换很不自然。多通道交互是近年来迅速发展起来的一种人机交互技术,它适应了“以人为中心”的自然交互准则,也被诸多研究证明是提高交互效率和自然性的有效途径。随着多通道用户界面的不断发展,多通道交互技术已经在一些面向儿童的交互系统中得到了应用。 本文主要在面向儿童的讲故事应用以及基于笔和语音的多通道融合方面提出了一些新的解决方法,设计并实现了多通道儿童讲故事系统,采用自然交互通道,增强儿童的想象力和创造力,进一步提高儿童的语言能力。本文的主要工作如下: 1.针对多通道交互模式在面向儿童这个用户群体的应用情况,分析总结了儿童语言的特点,结合受限的语言集合及其理解机制,分析儿童讲述故事时的上下文环境,将传统的多通道语义融合与上下文结合起来,提出基于上下文的多通道语义融合模型及其相关算法。 2.以儿童用户为目标群体,采用以用户为中心的场景设计方法,描述用户的交互操作;分析儿童讲故事的现实场景和需求,采用界面场景给出了原型系统的设计方案。 3.在上述研究工作的支持下,实现了采用笔和语音的多通道交互作为交互手段的三维的儿童讲故事系统;系统运用了基于上下文的多通道语义融合方法以及笔式三维交互技术,实现了包括多通道语义融合,交互式故事设计,三维动画生成,用户反馈修正在内的主要功能。 4.分析并评估了基于界面场景的评估方法在可用性评估过程中的优点;并应用该方法对儿童讲故事系统进行可用性评估,调查分析用户的使用习惯、对于软件的喜好程度、以及进一步的改进方案。
英文摘要: As more and more children begin to use computer, technology is changing the way children live and learn from school learning experiences to after-school play. Storytelling have been found to play an important role during a child’s growing up. Children learn to understand the world and culture surrounding them, and to recognize and blend themselves into the social and cultural context, by telling stories. However, due to the unnatural switch operation, the traditional interaction style with mouse and keyboard is not suitable for children. Recently, the multimodal interaction is a rapidly developing technique in the Human-Computer Interaction. It adapts the “human- centered” principle of natural interaction and has been proved to be a valid way to improve the efficiency and the naturality of interaction by a lot of research work. With the development of the multimodal user interfaces, the multimodal interaction has been applied in several children’s interaction systems. The thesis presents some novice method focus on the application of children’s storytelling and the multimodal fusion. A multimodal storytelling system has been designed and developed for children, which uses the natural interaction modal to enhance the imagination and creativity of children and to develop their linguistic ability. The main contributions of the thesis are: 1.Children’s multimodal patten is not as same as the adults. The thesis introduced a restricted language set and its understanding based on the characteristic of children’s language. The thesis also presents a context-based multimodal fusion method combining the former multimodal fusion method and the story context of children. 2.As children are our target users, user-centered scenario-based design method is used to describe the interaction operation of children. The thesis introduces the interface scenario and presents the the design of the prototype through analyzing the real storytelling scenario and requirement. 3.A 3D storytelling system has been developed for children with pen- and speech-based multimodal interaction style. The system uses the context-based multimodal fusion method and the pen-based 3D interaction technique. It includes the functions such as multimodal semantic fusion, interactive story design, 3D animation generating and user’s feedback and correcting. 4.A evaluation method based on interface scenario has been analyzed and evaluated to be a effective method used in the usability evaluation process. And this method has been applied to evaluate the storytelling system mentioned above. The results are used to investigate the user’s habit, the satisfaction and to establish farther improving solution.
语种: 中文
内容类型: 学位论文
URI标识: http://ir.iscas.ac.cn/handle/311060/5574
Appears in Collections:中科院软件所

Files in This Item:
File Name/ File Size Content Type Version Access License
10001_200428015029094张婕_paper.doc(9691KB)----限制开放-- 联系获取全文

Recommended Citation:
张婕. 基于笔和语音的多通道儿童讲故事系统[D]. 软件研究所. 中国科学院软件研究所. 2007-06-07.
Service
Recommend this item
Sava as my favorate item
Show this item's statistics
Export Endnote File
Google Scholar
Similar articles in Google Scholar
[张婕]'s Articles
CSDL cross search
Similar articles in CSDL Cross Search
[张婕]‘s Articles
Related Copyright Policies
Null
Social Bookmarking
Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit
所有评论 (0)
暂无评论
 
评注功能仅针对注册用户开放,请您登录
您对该条目有什么异议,请填写以下表单,管理员会尽快联系您。
内 容:
Email:  *
单位:
验证码:   刷新
您在IR的使用过程中有什么好的想法或者建议可以反馈给我们。
标 题:
 *
内 容:
Email:  *
验证码:   刷新

Items in IR are protected by copyright, with all rights reserved, unless otherwise indicated.

 

 

Valid XHTML 1.0!
Copyright © 2007-2017  中国科学院软件研究所 - Feedback
Powered by CSpace