Affiliation:
1. Economics and Info-Metrics Institute, American University, Washington, DC 20016
2. Santa Fe Institute, Santa Fe, NM 87501
3. Ecosystem Sciences, University of California, Berkeley, CA 94720
Abstract
Modeling and inference are central to most areas of science and especially to evolving and complex systems. Critically, the information we have is often uncertain and insufficient, resulting in an underdetermined inference problem; multiple inferences, models, and theories are consistent with available information. Information theory (in particular, the maximum information entropy formalism) provides a way to deal with such complexity. It has been applied to numerous problems, within and across many disciplines, over the last few decades. In this perspective, we review the historical development of this procedure, provide an overview of the many applications of maximum entropy and its extensions to complex systems, and discuss in more detail some recent advances in constructing comprehensive theory based on this inference procedure. We also discuss efforts at the frontier of information-theoretic inference: application to complex dynamic systems with time-varying constraints, such as highly disturbed ecosystems or rapidly changing economies.
Publisher
Proceedings of the National Academy of Sciences
Reference83 articles.
1. Data analysis: The maximum entropy method
2. Information Theory and Statistical Mechanics
3. J. Bernoulli, Ars Conjectandi (Thurneysen Brothers, 1713).
4. A letter to the Right Honourable George Earl of Macclesfield, President of the Royal Society, on the advantage of taking the mean of a number of observations, in practical astronomy;Simpson T.;Philos. Trans. R. Soc. Lond.,1755
5. An essay towards solving a problem in the doctrine of chances;Bayes T.;Philos. Trans. R. Soc. Lond.,1764
Cited by
23 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献