ISCAS OpenIR
script-to-movie: a computational framework for story movie composition
Liang Chao; Xu Changsheng; Cheng Jian; Min Weiqing; Lu Hanqing
2013
SourceIEEE Transactions on Multimedia
ISSN1520-9210
Volume15Issue:2Pages:401-414
English AbstractTraditional movie production has always been a highly professional work that needs team collaboration, advanced devices and techniques, and vast time and money investment. These high threshold requirements not only prevent mass amateur enthusiasts entering this field, but also hinder professionals quickly previewing their conceived story plots. In this paper, we raise a novel application, named script-to-movie (S2M) composition, to automatically produce new movies from existing videos in accordance with user created script. Our motivation is to liberate producers from complex filming and editing operations, thereby people's story idea can be instantly converted into the vivid movie video. To support the novel 'What You Dream Is What You See' (WYDIWYS) production mode, we first propose a hierarchical alignment method to automatically construct a video material database with detailed semantic description. Considering diverse story plots in user designed script, the database contains abundant video materials about different characters appearing in various time and places conditions. On this basis, the S2M composition is formulated as a constrained optimization problem, where semantic story plot and syntactic visual content are synthetically considered to identify a group of optimal video segments to narrate the user designed script story. Both quantitative and qualitative experimental results are reported to illustrate the effectiveness of the proposed S2M application. © 1999-2012 IEEE.; Traditional movie production has always been a highly professional work that needs team collaboration, advanced devices and techniques, and vast time and money investment. These high threshold requirements not only prevent mass amateur enthusiasts entering this field, but also hinder professionals quickly previewing their conceived story plots. In this paper, we raise a novel application, named script-to-movie (S2M) composition, to automatically produce new movies from existing videos in accordance with user created script. Our motivation is to liberate producers from complex filming and editing operations, thereby people's story idea can be instantly converted into the vivid movie video. To support the novel 'What You Dream Is What You See' (WYDIWYS) production mode, we first propose a hierarchical alignment method to automatically construct a video material database with detailed semantic description. Considering diverse story plots in user designed script, the database contains abundant video materials about different characters appearing in various time and places conditions. On this basis, the S2M composition is formulated as a constrained optimization problem, where semantic story plot and syntactic visual content are synthetically considered to identify a group of optimal video segments to narrate the user designed script story. Both quantitative and qualitative experimental results are reported to illustrate the effectiveness of the proposed S2M application. © 1999-2012 IEEE.
Indexed TypeEI
KeywordConstrained Optimization Semantics
Department(1) National Lab of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing 100190 China; (2) National Engineering Research Center on Multimedia Software School of Computer Science Wuhan University Wuhan 430079 China; (3) China-Singapore Institute of Digital Media Singapore 119615 Singapore
Language英语
Content Type期刊论文
URIhttp://ir.iscas.ac.cn/handle/311060/15224
Collection中国科学院软件研究所
Recommended Citation
GB/T 7714
Liang Chao,Xu Changsheng,Cheng Jian,et al. script-to-movie: a computational framework for story movie composition[J]. IEEE Transactions on Multimedia,2013,15(2):401-414.
APA Liang Chao,Xu Changsheng,Cheng Jian,Min Weiqing,&Lu Hanqing.(2013).script-to-movie: a computational framework for story movie composition.IEEE Transactions on Multimedia,15(2),401-414.
MLA Liang Chao,et al."script-to-movie: a computational framework for story movie composition".IEEE Transactions on Multimedia 15.2(2013):401-414.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Liang Chao]'s Articles
[Xu Changsheng]'s Articles
[Cheng Jian]'s Articles
Baidu academic
Similar articles in Baidu academic
[Liang Chao]'s Articles
[Xu Changsheng]'s Articles
[Cheng Jian]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Liang Chao]'s Articles
[Xu Changsheng]'s Articles
[Cheng Jian]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.