Institutional Repository
| Structural Information and Dynamical Complexity of Networks | |
| Li, AS; Pan, YC | |
| 2016 | |
| Source | IEEE TRANSACTIONS ON INFORMATION THEORY
![]() |
| ISSN | 0018-9448 |
| Volume | 62Issue:6Pages:3290-3339 |
| English Abstract | In 1953, Shannon proposed the question of quantification of structural information to analyze communication systems. The question has become one of the longest great challenges in information science and computer science. Here, we propose the first metric for structural information. Given a graph G, we define the K-dimensional structural information of G (or structure entropy of G), denoted by H-K (G), to be the minimum overall number of bits required to determine the K-dimensional code of the node that is accessible from random walk in G. The K-dimensional structural information provides the principle for completely detecting the natural or true structure, which consists of the rules, regulations, and orders of the graphs, for fully distinguishing the order from disorder in structured noisy data, and for analyzing communication systems, solving the Shannon's problem and opening up new directions. The K-dimensional structural information is also the first metric of dynamical complexity of networks, measuring the complexity of interactions, communications, operations, and even evolution of networks. The metric satisfies a number of fundamental properties, including additivity, locality, robustness, local and incremental computability, and so on. We establish the fundamental theorems of the one-and two-dimensional structural information of networks, including both lower and upper bounds of the metrics of classic data structures, general graphs, the networks of models, and the networks of natural evolution. We propose algorithms to approximate the K-dimensional structural information of graphs by finding the K-dimensional structure of the graphs that minimizes the K-dimensional structure entropy. We find that the K-dimensional structure entropy minimization is the principle for detecting the natural or true structures in real-world networks. Consequently, our structural information provides the foundation for knowledge discovering from noisy data. We establish a black hole principle by using the two-dimensional structure information of graphs. We propose the natural rank of locally listing algorithms by the structure entropy minimization principle, providing the basis for a next-generation search engine.; In 1953, Shannon proposed the question of quantification of structural information to analyze communication systems. The question has become one of the longest great challenges in information science and computer science. Here, we propose the first metric for structural information. Given a graph G, we define the K-dimensional structural information of G (or structure entropy of G), denoted by H-K (G), to be the minimum overall number of bits required to determine the K-dimensional code of the node that is accessible from random walk in G. The K-dimensional structural information provides the principle for completely detecting the natural or true structure, which consists of the rules, regulations, and orders of the graphs, for fully distinguishing the order from disorder in structured noisy data, and for analyzing communication systems, solving the Shannon's problem and opening up new directions. The K-dimensional structural information is also the first metric of dynamical complexity of networks, measuring the complexity of interactions, communications, operations, and even evolution of networks. The metric satisfies a number of fundamental properties, including additivity, locality, robustness, local and incremental computability, and so on. We establish the fundamental theorems of the one-and two-dimensional structural information of networks, including both lower and upper bounds of the metrics of classic data structures, general graphs, the networks of models, and the networks of natural evolution. We propose algorithms to approximate the K-dimensional structural information of graphs by finding the K-dimensional structure of the graphs that minimizes the K-dimensional structure entropy. We find that the K-dimensional structure entropy minimization is the principle for detecting the natural or true structures in real-world networks. Consequently, our structural information provides the foundation for knowledge discovering from noisy data. We establish a black hole principle by using the two-dimensional structure information of graphs. We propose the natural rank of locally listing algorithms by the structure entropy minimization principle, providing the basis for a next-generation search engine. |
| Indexed Type | SCI |
| Keyword | Shannon Entropy Structural Information Dynamical Complexity Of Networks Graph Characterisation Networks |
| Department | Chinese Acad Sci, State Key Lab Comp Sci, Beijing 100190, Peoples R China. Chinese Acad Sci, Inst Software, Beijing 100190, Peoples R China. |
| Language | 英语 |
| WOS ID | WOS:000380070600022 |
| Citation statistics | |
| Content Type | 期刊论文 |
| URI | http://ir.iscas.ac.cn/handle/311060/17329 |
| Collection | 中国科学院软件研究所 |
| Recommended Citation GB/T 7714 | Li, AS,Pan, YC. Structural Information and Dynamical Complexity of Networks[J]. IEEE TRANSACTIONS ON INFORMATION THEORY,2016,62(6):3290-3339. |
| APA | Li, AS,&Pan, YC.(2016).Structural Information and Dynamical Complexity of Networks.IEEE TRANSACTIONS ON INFORMATION THEORY,62(6),3290-3339. |
| MLA | Li, AS,et al."Structural Information and Dynamical Complexity of Networks".IEEE TRANSACTIONS ON INFORMATION THEORY 62.6(2016):3290-3339. |
| Files in This Item: | ||||||
| File Name/Size | DocType | Version | Access | License | ||
| 07456290.pdf(2531KB) | 开放获取 | License | Application Full Text | |||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment