TY - JOUR

T1 - Principles of maximum entropy and maximum caliber in statistical physics

AU - Pressé, Steve

AU - Ghosh, Kingshuk

AU - Lee, Julian

AU - Dill, Ken A.

PY - 2013/7/16

Y1 - 2013/7/16

N2 - The variational principles called maximum entropy (MaxEnt) and maximum caliber (MaxCal) are reviewed. MaxEnt originated in the statistical physics of Boltzmann and Gibbs, as a theoretical tool for predicting the equilibrium states of thermal systems. Later, entropy maximization was also applied to matters of information, signal transmission, and image reconstruction. Recently, since the work of Shore and Johnson, MaxEnt has been regarded as a principle that is broader than either physics or information alone. MaxEnt is a procedure that ensures that inferences drawn from stochastic data satisfy basic self-consistency requirements. The different historical justifications for the entropy S=-Σipilogâ¡pi and its corresponding variational principles are reviewed. As an illustration of the broadening purview of maximum entropy principles, maximum caliber, which is path entropy maximization applied to the trajectories of dynamical systems, is also reviewed. Examples are given in which maximum caliber is used to interpret dynamical fluctuations in biology and on the nanoscale, in single-molecule and few-particle systems such as molecular motors, chemical reactions, biological feedback circuits, and diffusion in microfluidics devices.

AB - The variational principles called maximum entropy (MaxEnt) and maximum caliber (MaxCal) are reviewed. MaxEnt originated in the statistical physics of Boltzmann and Gibbs, as a theoretical tool for predicting the equilibrium states of thermal systems. Later, entropy maximization was also applied to matters of information, signal transmission, and image reconstruction. Recently, since the work of Shore and Johnson, MaxEnt has been regarded as a principle that is broader than either physics or information alone. MaxEnt is a procedure that ensures that inferences drawn from stochastic data satisfy basic self-consistency requirements. The different historical justifications for the entropy S=-Σipilogâ¡pi and its corresponding variational principles are reviewed. As an illustration of the broadening purview of maximum entropy principles, maximum caliber, which is path entropy maximization applied to the trajectories of dynamical systems, is also reviewed. Examples are given in which maximum caliber is used to interpret dynamical fluctuations in biology and on the nanoscale, in single-molecule and few-particle systems such as molecular motors, chemical reactions, biological feedback circuits, and diffusion in microfluidics devices.

UR - http://www.scopus.com/inward/record.url?scp=84882279791&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84882279791&partnerID=8YFLogxK

U2 - 10.1103/RevModPhys.85.1115

DO - 10.1103/RevModPhys.85.1115

M3 - Article

AN - SCOPUS:84882279791

SN - 0034-6861

VL - 85

SP - 1115

EP - 1141

JO - Reviews of Modern Physics

JF - Reviews of Modern Physics

IS - 3

ER -