Diversity of information pathways drives sparsity in real-world networks

Complex systems must respond to external perturbations and, at the same time, internally distribute information to coordinate their components. Although networked backbones help with the latter, they limit the components’ individual degrees of freedom and reduce their collective dynamical range. Here we show that real-world networks balance the loss of response diversity with gain in information flow. Encoding network states as density matrices, we demonstrate that such a trade-off mathematically resembles the thermodynamic efficiency characterized by heat and work in physical systems, providing a variational principle to macroscopically explain the sparsity and empirical scaling law observed in hundreds of real-world networks across multiple domains, both analytically and numerically. We show that the emergence of topological features such as modularity, small-worldness and heterogeneity agrees with maximizing the trade-off between information exchange and response diversity from middle to large temporal scales. Our results suggest that the emergence of some of the most prevalent topological features of real-world networks might have a thermodynamic origin.