ISCAS OpenIR
script-to-movie: a computational framework for story movie composition
Liang Chao; Xu Changsheng; Cheng Jian; Min Weiqing; Lu Hanqing
2013
发表期刊IEEE Transactions on Multimedia
ISSN1520-9210
卷号15期号:2页码:401-414
摘要Traditional movie production has always been a highly professional work that needs team collaboration, advanced devices and techniques, and vast time and money investment. These high threshold requirements not only prevent mass amateur enthusiasts entering this field, but also hinder professionals quickly previewing their conceived story plots. In this paper, we raise a novel application, named script-to-movie (S2M) composition, to automatically produce new movies from existing videos in accordance with user created script. Our motivation is to liberate producers from complex filming and editing operations, thereby people's story idea can be instantly converted into the vivid movie video. To support the novel 'What You Dream Is What You See' (WYDIWYS) production mode, we first propose a hierarchical alignment method to automatically construct a video material database with detailed semantic description. Considering diverse story plots in user designed script, the database contains abundant video materials about different characters appearing in various time and places conditions. On this basis, the S2M composition is formulated as a constrained optimization problem, where semantic story plot and syntactic visual content are synthetically considered to identify a group of optimal video segments to narrate the user designed script story. Both quantitative and qualitative experimental results are reported to illustrate the effectiveness of the proposed S2M application. © 1999-2012 IEEE.; Traditional movie production has always been a highly professional work that needs team collaboration, advanced devices and techniques, and vast time and money investment. These high threshold requirements not only prevent mass amateur enthusiasts entering this field, but also hinder professionals quickly previewing their conceived story plots. In this paper, we raise a novel application, named script-to-movie (S2M) composition, to automatically produce new movies from existing videos in accordance with user created script. Our motivation is to liberate producers from complex filming and editing operations, thereby people's story idea can be instantly converted into the vivid movie video. To support the novel 'What You Dream Is What You See' (WYDIWYS) production mode, we first propose a hierarchical alignment method to automatically construct a video material database with detailed semantic description. Considering diverse story plots in user designed script, the database contains abundant video materials about different characters appearing in various time and places conditions. On this basis, the S2M composition is formulated as a constrained optimization problem, where semantic story plot and syntactic visual content are synthetically considered to identify a group of optimal video segments to narrate the user designed script story. Both quantitative and qualitative experimental results are reported to illustrate the effectiveness of the proposed S2M application. © 1999-2012 IEEE.
收录类别EI
关键词Constrained Optimization Semantics
部门归属(1) National Lab of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing 100190 China; (2) National Engineering Research Center on Multimedia Software School of Computer Science Wuhan University Wuhan 430079 China; (3) China-Singapore Institute of Digital Media Singapore 119615 Singapore
语种英语
内容类型期刊论文
URI标识http://ir.iscas.ac.cn/handle/311060/15224
专题中国科学院软件研究所
推荐引用方式
GB/T 7714
Liang Chao,Xu Changsheng,Cheng Jian,et al. script-to-movie: a computational framework for story movie composition[J]. IEEE Transactions on Multimedia,2013,15(2):401-414.
APA Liang Chao,Xu Changsheng,Cheng Jian,Min Weiqing,&Lu Hanqing.(2013).script-to-movie: a computational framework for story movie composition.IEEE Transactions on Multimedia,15(2),401-414.
MLA Liang Chao,et al."script-to-movie: a computational framework for story movie composition".IEEE Transactions on Multimedia 15.2(2013):401-414.
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Liang Chao]的文章
[Xu Changsheng]的文章
[Cheng Jian]的文章
百度学术
百度学术中相似的文章
[Liang Chao]的文章
[Xu Changsheng]的文章
[Cheng Jian]的文章
必应学术
必应学术中相似的文章
[Liang Chao]的文章
[Xu Changsheng]的文章
[Cheng Jian]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。