Information Theory and Statistical Mechanics

E. T. Jaynes
Phys. Rev. 106, 620 – Published 15 May 1957
PDFExport Citation

Abstract

Information theory provides a constructive criterion for setting up probability distributions on the basis of partial knowledge, and leads to a type of statistical inference which is called the maximum-entropy estimate. It is the least biased estimate possible on the given information; i.e., it is maximally noncommittal with regard to missing information. If one considers statistical mechanics as a form of statistical inference rather than as a physical theory, it is found that the usual computational rules, starting with the determination of the partition function, are an immediate consequence of the maximum-entropy principle. In the resulting "subjective statistical mechanics," the usual rules are thus justified independently of any physical argument, and in particular independently of experimental verification; whether or not the results agree with experiment, they still represent the best estimates that could have been made on the basis of the information available.

It is concluded that statistical mechanics need not be regarded as a physical theory dependent for its validity on the truth of additional assumptions not contained in the laws of mechanics (such as ergodicity, metric transitivity, equal a priori probabilities, etc.). Furthermore, it is possible to maintain a sharp distinction between its physical and statistical aspects. The former consists only of the correct enumeration of the states of a system and their properties; the latter is a straightforward example of statistical inference.

  • Received 4 September 1956

DOI:https://doi.org/10.1103/PhysRev.106.620

©1957 American Physical Society

Authors & Affiliations

E. T. Jaynes

  • Department of Physics, Stanford University, Stanford, California

References (Subscription Required)

Click to Expand
Issue

Vol. 106, Iss. 4 — May 1957

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review Journals Archive

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×