Title: script-to-movie: a computational framework for story movie composition
Author: Liang Chao
; Xu Changsheng
; Cheng Jian
; Min Weiqing
; Lu Hanqing
Keyword: Constrained optimization
; Semantics
Source: IEEE Transactions on Multimedia
Issued Date: 2013
Volume: 15, Issue: 2, Pages: 401-414 Indexed Type: EI
Department: (1) National Lab of Pattern Recognition Institute of Automation Chinese Academy of Sciences Beijing 100190 China; (2) National Engineering Research Center on Multimedia Software School of Computer Science Wuhan University Wuhan 430079 China; (3) China-Singapore Institute of Digital Media Singapore 119615 Singapore
Abstract: Traditional movie production has always been a highly professional work that needs team collaboration, advanced devices and techniques, and vast time and money investment. These high threshold requirements not only prevent mass amateur enthusiasts entering this field, but also hinder professionals quickly previewing their conceived story plots. In this paper, we raise a novel application, named script-to-movie (S2M) composition, to automatically produce new movies from existing videos in accordance with user created script. Our motivation is to liberate producers from complex filming and editing operations, thereby people's story idea can be instantly converted into the vivid movie video. To support the novel 'What You Dream Is What You See' (WYDIWYS) production mode, we first propose a hierarchical alignment method to automatically construct a video material database with detailed semantic description. Considering diverse story plots in user designed script, the database contains abundant video materials about different characters appearing in various time and places conditions. On this basis, the S2M composition is formulated as a constrained optimization problem, where semantic story plot and syntactic visual content are synthetically considered to identify a group of optimal video segments to narrate the user designed script story. Both quantitative and qualitative experimental results are reported to illustrate the effectiveness of the proposed S2M application. © 1999-2012 IEEE. English Abstract: Traditional movie production has always been a highly professional work that needs team collaboration, advanced devices and techniques, and vast time and money investment. These high threshold requirements not only prevent mass amateur enthusiasts entering this field, but also hinder professionals quickly previewing their conceived story plots. In this paper, we raise a novel application, named script-to-movie (S2M) composition, to automatically produce new movies from existing videos in accordance with user created script. Our motivation is to liberate producers from complex filming and editing operations, thereby people's story idea can be instantly converted into the vivid movie video. To support the novel 'What You Dream Is What You See' (WYDIWYS) production mode, we first propose a hierarchical alignment method to automatically construct a video material database with detailed semantic description. Considering diverse story plots in user designed script, the database contains abundant video materials about different characters appearing in various time and places conditions. On this basis, the S2M composition is formulated as a constrained optimization problem, where semantic story plot and syntactic visual content are synthetically considered to identify a group of optimal video segments to narrate the user designed script story. Both quantitative and qualitative experimental results are reported to illustrate the effectiveness of the proposed S2M application. © 1999-2012 IEEE. Language: 英语
Content Type: 期刊论文
URI: http://ir.iscas.ac.cn/handle/311060/15224
Appears in Collections: 软件所图书馆_期刊论文
There are no files associated with this item.
Recommended Citation:
Liang Chao,Xu Changsheng,Cheng Jian,et al. script-to-movie: a computational framework for story movie composition[J]. IEEE Transactions on Multimedia,2013-01-01,15(2):401-414.
