video enhancement leveraging high-quality depth maps

ISCAS OpenIR

	video enhancement leveraging high-quality depth maps
	Cai Zhongmou; Wu Enhua
	2012
会议名称	11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2012
会议录名称	Proceedings - VRCAI 2012: 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
页码	111-117
会议日期	December 2, 2012 - December 4, 2012
会议地点	Singapore, Singapore
收录类别	EI
ISBN	9781450318259
部门归属	(1) Department of Computer and Information Science University of Macau China; (2) State Key Laboratory of Computer Science Institute of Software Chinese Academy of Sciences Beijing China
摘要	Using an image-based rendering (IBR) algorithm, we can reconstruct and enhance a low-quality video by extracting colors from several high-quality photographs according to the correspondences. In this paper, we present several improvements for the IBR algorithm to improve the reconstruction faithfulness and temporal coherence of the resultant video. Concretely, we propose to use another state-of-the-art multiview stereo (MVS) method to recover more accurate and highly consistent depths for the video, and adapt it to handle the sparse photographs. Leveraging the consistent video depths, we further propose a simple but effective method to generate more faithful photograph candidates, which also helps to maintain the temporal coherence. The effectiveness of our improvements is verified by achieving the effect of video super-resolution. Besides, we improve the structure-from-motion (SfM) system to process the heterogeneous dataset containing several unordered photographs and a video clip more efficiently for our application. © 2012 ACM.; Using an image-based rendering (IBR) algorithm, we can reconstruct and enhance a low-quality video by extracting colors from several high-quality photographs according to the correspondences. In this paper, we present several improvements for the IBR algorithm to improve the reconstruction faithfulness and temporal coherence of the resultant video. Concretely, we propose to use another state-of-the-art multiview stereo (MVS) method to recover more accurate and highly consistent depths for the video, and adapt it to handle the sparse photographs. Leveraging the consistent video depths, we further propose a simple but effective method to generate more faithful photograph candidates, which also helps to maintain the temporal coherence. The effectiveness of our improvements is verified by achieving the effect of video super-resolution. Besides, we improve the structure-from-motion (SfM) system to process the heterogeneous dataset containing several unordered photographs and a video clip more efficiently for our application. © 2012 ACM.
关键词	Algorithms Image Reconstruction Interactive Computer Graphics Optical Resolving Power
主办者	ACM SIGGRAPH
语种	英语
内容类型	会议论文
URI标识	http://ir.iscas.ac.cn/handle/311060/15814
专题	中国科学院软件研究所
推荐引用方式 GB/T 7714	Cai Zhongmou,Wu Enhua. video enhancement leveraging high-quality depth maps[C],2012:111-117.