Institutional Repository
| Mining streams of short text for analysis of world-wide event evolutions | |
| Huang, Guangyan (1); He, Jing (2); Zhang, Yanchun (2); Zhou, Wanlei (1); Liu, Hai (3); Zhang, Peng (2); Ding, Zhiming (4); You, Yue (5); Cao, Jian (5); Huang, G.(guangyan.huang@gmail.com) | |
| 2014 | |
| Source | World Wide Web
 |
| ISSN | 1386145X |
| English Abstract | Streams of short text, such as news titles, enable us to effectively and efficiently learn the real world events that occur anywhere and anytime. Short text messages that are companied by timestamps and generally brief events using only a few words differ from other longer text documents, such as web pages, news stories, blogs, technical papers and books. For example, few words repeat in the same news titles, thus frequency of the term (i.e., TF) is not as important in short text corpus as in longer text corpus. Therefore, analysis of short text faces new challenges. Also, detecting and tracking events through short text analysis need to reliably identify events from constant topic clusters; however, existing methods, such as Latent Dirichlet Allocation (LDA), generates different topic results for a corpus at different executions. In this paper, we provide a Finding Topic Clusters using Co-occurring Terms (FTCCT) algorithm to automatically generate topics from a short text corpus, and develop an Event Evolution Mining (EEM) algorithm to discover hot events and their evolutions (i.e., the popularity degrees of events changing over time). In FTCCT, a term (i.e., a single word or a multiple-words phrase) belongs to only one topic in a corpus. Experiments on news titles of 157 countries within 4 months (from July to October, 2013) demonstrate that our FTCCT-based method (combining FTCCT and EEM) achieves far higher quality of the event's content and description words than LDA-based method (combining LDA and EEM) for analysis of streams of short text. Our method also visualizes the evolutions of the hot events. The discovered world-wide event evolutions have explored some interesting correlations of the world-wide events; for example, successive extreme weather phenomenon occur in different locations - typhoon in Hong Kong and Philippines followed hurricane and storm flood in Mexico in September 2013. © 2014 Springer Science+Business Media New York.; Streams of short text, such as news titles, enable us to effectively and efficiently learn the real world events that occur anywhere and anytime. Short text messages that are companied by timestamps and generally brief events using only a few words differ from other longer text documents, such as web pages, news stories, blogs, technical papers and books. For example, few words repeat in the same news titles, thus frequency of the term (i.e., TF) is not as important in short text corpus as in longer text corpus. Therefore, analysis of short text faces new challenges. Also, detecting and tracking events through short text analysis need to reliably identify events from constant topic clusters; however, existing methods, such as Latent Dirichlet Allocation (LDA), generates different topic results for a corpus at different executions. In this paper, we provide a Finding Topic Clusters using Co-occurring Terms (FTCCT) algorithm to automatically generate topics from a short text corpus, and develop an Event Evolution Mining (EEM) algorithm to discover hot events and their evolutions (i.e., the popularity degrees of events changing over time). In FTCCT, a term (i.e., a single word or a multiple-words phrase) belongs to only one topic in a corpus. Experiments on news titles of 157 countries within 4 months (from July to October, 2013) demonstrate that our FTCCT-based method (combining FTCCT and EEM) achieves far higher quality of the event's content and description words than LDA-based method (combining LDA and EEM) for analysis of streams of short text. Our method also visualizes the evolutions of the hot events. The discovered world-wide event evolutions have explored some interesting correlations of the world-wide events; for example, successive extreme weather phenomenon occur in different locations - typhoon in Hong Kong and Philippines followed hurricane and storm flood in Mexico in September 2013. © 2014 Springer Science+Business Media New York. |
| Indexed Type | EI |
| Department | (1) School of Information Technology, Deakin University, Victoria, Australia; (2) Centre for Applied Informatics, College of Engineering and Science, Victoria University, Victoria, Australia; (3) Computer Science Department, South China Normal University, Guangzhou, China; (4) State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China; (5) Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China |
| Language | 英语 |
| WOS ID | WOS:000360079000002 |
| Citation statistics | |
| Content Type | 期刊论文 |
| URI | http://ir.iscas.ac.cn/handle/311060/17034 |
| Collection | 中国科学院软件研究所 |
| Corresponding Author | Huang, G.(guangyan.huang@gmail.com) |
| Recommended Citation GB/T 7714 | Huang, Guangyan ,He, Jing ,Zhang, Yanchun ,et al. Mining streams of short text for analysis of world-wide event evolutions[J]. World Wide Web,2014. |
| APA | Huang, Guangyan .,He, Jing .,Zhang, Yanchun .,Zhou, Wanlei .,Liu, Hai .,...&Huang, G..(2014).Mining streams of short text for analysis of world-wide event evolutions.World Wide Web. |
| MLA | Huang, Guangyan ,et al."Mining streams of short text for analysis of world-wide event evolutions".World Wide Web (2014). |
| Files in This Item: | There are no files associated with this item. | |||||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment