Mining streams of short text for analysis of world-wide event evolutions

ISCAS OpenIR

	Mining streams of short text for analysis of world-wide event evolutions
	Huang, Guangyan (1); He, Jing (2); Zhang, Yanchun (2); Zhou, Wanlei (1); Liu, Hai (3); Zhang, Peng (2); Ding, Zhiming (4); You, Yue (5); Cao, Jian (5); Huang, G.(guangyan.huang@gmail.com)
	2014
发表期刊	World Wide Web
ISSN	1386145X
摘要	Streams of short text, such as news titles, enable us to effectively and efficiently learn the real world events that occur anywhere and anytime. Short text messages that are companied by timestamps and generally brief events using only a few words differ from other longer text documents, such as web pages, news stories, blogs, technical papers and books. For example, few words repeat in the same news titles, thus frequency of the term (i.e., TF) is not as important in short text corpus as in longer text corpus. Therefore, analysis of short text faces new challenges. Also, detecting and tracking events through short text analysis need to reliably identify events from constant topic clusters; however, existing methods, such as Latent Dirichlet Allocation (LDA), generates different topic results for a corpus at different executions. In this paper, we provide a Finding Topic Clusters using Co-occurring Terms (FTCCT) algorithm to automatically generate topics from a short text corpus, and develop an Event Evolution Mining (EEM) algorithm to discover hot events and their evolutions (i.e., the popularity degrees of events changing over time). In FTCCT, a term (i.e., a single word or a multiple-words phrase) belongs to only one topic in a corpus. Experiments on news titles of 157 countries within 4 months (from July to October, 2013) demonstrate that our FTCCT-based method (combining FTCCT and EEM) achieves far higher quality of the event's content and description words than LDA-based method (combining LDA and EEM) for analysis of streams of short text. Our method also visualizes the evolutions of the hot events. The discovered world-wide event evolutions have explored some interesting correlations of the world-wide events; for example, successive extreme weather phenomenon occur in different locations - typhoon in Hong Kong and Philippines followed hurricane and storm flood in Mexico in September 2013. © 2014 Springer Science+Business Media New York.; Streams of short text, such as news titles, enable us to effectively and efficiently learn the real world events that occur anywhere and anytime. Short text messages that are companied by timestamps and generally brief events using only a few words differ from other longer text documents, such as web pages, news stories, blogs, technical papers and books. For example, few words repeat in the same news titles, thus frequency of the term (i.e., TF) is not as important in short text corpus as in longer text corpus. Therefore, analysis of short text faces new challenges. Also, detecting and tracking events through short text analysis need to reliably identify events from constant topic clusters; however, existing methods, such as Latent Dirichlet Allocation (LDA), generates different topic results for a corpus at different executions. In this paper, we provide a Finding Topic Clusters using Co-occurring Terms (FTCCT) algorithm to automatically generate topics from a short text corpus, and develop an Event Evolution Mining (EEM) algorithm to discover hot events and their evolutions (i.e., the popularity degrees of events changing over time). In FTCCT, a term (i.e., a single word or a multiple-words phrase) belongs to only one topic in a corpus. Experiments on news titles of 157 countries within 4 months (from July to October, 2013) demonstrate that our FTCCT-based method (combining FTCCT and EEM) achieves far higher quality of the event's content and description words than LDA-based method (combining LDA and EEM) for analysis of streams of short text. Our method also visualizes the evolutions of the hot events. The discovered world-wide event evolutions have explored some interesting correlations of the world-wide events; for example, successive extreme weather phenomenon occur in different locations - typhoon in Hong Kong and Philippines followed hurricane and storm flood in Mexico in September 2013. © 2014 Springer Science+Business Media New York.
收录类别	EI
部门归属	(1) School of Information Technology, Deakin University, Victoria, Australia; (2) Centre for Applied Informatics, College of Engineering and Science, Victoria University, Victoria, Australia; (3) Computer Science Department, South China Normal University, Guangzhou, China; (4) State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China; (5) Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
语种	英语
WOS记录号	WOS:000360079000002
引用统计
内容类型	期刊论文
URI标识	http://ir.iscas.ac.cn/handle/311060/17034
专题	中国科学院软件研究所
通讯作者	Huang, G.(guangyan.huang@gmail.com)
推荐引用方式 GB/T 7714	Huang, Guangyan ,He, Jing ,Zhang, Yanchun ,et al. Mining streams of short text for analysis of world-wide event evolutions[J]. World Wide Web,2014.
APA	Huang, Guangyan .,He, Jing .,Zhang, Yanchun .,Zhou, Wanlei .,Liu, Hai .,...&Huang, G..(2014).Mining streams of short text for analysis of world-wide event evolutions.World Wide Web.
MLA	Huang, Guangyan ,et al."Mining streams of short text for analysis of world-wide event evolutions".World Wide Web (2014).