Institutional Repository
| A sketch-based approach for interactive organization of video clips | |
| Liu, Yong-Jin (1); Ma, Cui-Xia (2); Fu, Qiufang (3); Fu, Xiaolan (3); Qin, Sheng-Feng (4); Xie, Lexing (5); Liu, Y.-J.(liuyongjin@tsinghua.edu.cn) | |
| 2014 | |
| Source | ACM Transactions on Multimedia Computing, Communications and Applications
 |
| ISSN | 15516857 |
| Volume | 11Issue:1 |
| English Abstract | With the rapid growth of video resources, techniques for efficient organization of video clips are becoming appealing in the multimedia domain. In this article, a sketch-based approach is proposed to intuitively organize video clips by: (1) enhancing their narrations using sketch annotations and (2) structurizing the organization process by gesture-based free-form sketching on touch devices. There are two main contributions of this work. The first is a sketch graph, a novel representation for the narrative structure of video clips to facilitate content organization. The second is a method to perform context-aware sketch recommendation scalable to large video collections, enabling common users to easily organize sketch annotations. A prototype system integrating the proposed approach was evaluated on the basis of five different aspects concerning its performance and usability. Two sketch searching experiments showed that the proposed context-aware sketch recommendation outperforms, in terms of accuracy and scalability, two state-of-the-art sketch searching methods. Moreover, a user study showed that the sketch graph is consistently preferred over traditional representations such as keywords and keyframes. The second user study showed that the proposed approach is applicable in those scenarios where the video annotator and organizer were the same person. The third user study showed that, for video content organization, using sketch graph users took on average 1/3 less time than using a mass-market tool Movie Maker and took on average 1/4 less time than using a state-of-theart sketch alternative. These results demonstrated that the proposed sketch graph approach is a promising video organization tool. © 2014 ACM.; With the rapid growth of video resources, techniques for efficient organization of video clips are becoming appealing in the multimedia domain. In this article, a sketch-based approach is proposed to intuitively organize video clips by: (1) enhancing their narrations using sketch annotations and (2) structurizing the organization process by gesture-based free-form sketching on touch devices. There are two main contributions of this work. The first is a sketch graph, a novel representation for the narrative structure of video clips to facilitate content organization. The second is a method to perform context-aware sketch recommendation scalable to large video collections, enabling common users to easily organize sketch annotations. A prototype system integrating the proposed approach was evaluated on the basis of five different aspects concerning its performance and usability. Two sketch searching experiments showed that the proposed context-aware sketch recommendation outperforms, in terms of accuracy and scalability, two state-of-the-art sketch searching methods. Moreover, a user study showed that the sketch graph is consistently preferred over traditional representations such as keywords and keyframes. The second user study showed that the proposed approach is applicable in those scenarios where the video annotator and organizer were the same person. The third user study showed that, for video content organization, using sketch graph users took on average 1/3 less time than using a mass-market tool Movie Maker and took on average 1/4 less time than using a state-of-theart sketch alternative. These results demonstrated that the proposed sketch graph approach is a promising video organization tool. © 2014 ACM. |
| Indexed Type | SCI ; EI |
| Keyword | Design Algorithms Performance Sketching Interface Video Organization Sketch Annotation Context-aware Recommendation |
| Department | (1) TNList, Department of Computer Science and Technology, Tsinghua University, China; (2) State Key Lab of Computer Science, Institute of Software, China; (3) State Key Lab of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, China; (4) Department of Design, Northumbria University, United Kingdom; (5) Research School of Computer Science, Australian National University, Australia |
| Language | 英语 |
| WOS ID | WOS:000341939800002 |
| Citation statistics | |
| Content Type | 期刊论文 |
| URI | http://ir.iscas.ac.cn/handle/311060/16838 |
| Collection | 中国科学院软件研究所 |
| Corresponding Author | Liu, Y.-J.(liuyongjin@tsinghua.edu.cn) |
| Recommended Citation GB/T 7714 | Liu, Yong-Jin ,Ma, Cui-Xia ,Fu, Qiufang ,et al. A sketch-based approach for interactive organization of video clips[J]. ACM Transactions on Multimedia Computing, Communications and Applications,2014,11(1). |
| APA | Liu, Yong-Jin .,Ma, Cui-Xia .,Fu, Qiufang .,Fu, Xiaolan .,Qin, Sheng-Feng .,...&Liu, Y.-J..(2014).A sketch-based approach for interactive organization of video clips.ACM Transactions on Multimedia Computing, Communications and Applications,11(1). |
| MLA | Liu, Yong-Jin ,et al."A sketch-based approach for interactive organization of video clips".ACM Transactions on Multimedia Computing, Communications and Applications 11.1(2014). |
| Files in This Item: | There are no files associated with this item. | |||||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment