nLab Bayes rule

Bayes rule

Bayes rule

Statement

In probability theory, the Bayes Rule (or Bayes's Law, Bayes' Theorem, or another permutation) is the statement that the conditional probabilities P(H|E)P(H\vert E) for an event HH, assuming an event EE is related to the condition probability P(E|H)P(E\vert H) of EE assuming HH, and the plain probabilities P(H)P(H) and P(E)P(E) for HH and EE separately, by

P(H|E)=P(E|H)P(H)P(E). P(H|E) \;=\; \frac{P(E|H) P(H)} {P(E)} \,.

This follows directly from the defining formula P(A|B)=P(AB)/P(B)P(A|B) = P(A \wedge B)/P(B) for conditional probability. The rule may also be written in the expanded form

P(H|E)=P(E|H)P(H)P(E|H)P(H)P(E|¬H)P(H)+P(E|¬H), P(H|E) = \frac{P(E|H) P(H)} {P(E|H) P(H) - P(E|\neg{H}) P(H) + P(E|\neg{H})} ,

which additionally uses some of the axioms of probability, or somewhere in between these two forms.

As a theorem, it is quite trivial; the point is in its application as a rule for updating the probability of some hypothesis (HH) on the basis of some evidence (EE) (which is key to Bayesianism), using the prior probability of the hypothesis before the evidence is obtained (P(H)P(H)) and (in the expanded form) the conditional probabilities of obtaining that evidence in the situation where the hypothesis is true (P(E|H)P(E|H)) and in the situation where the hypothesis is false (P(E|¬H)P(E|\neg{H})). (Ideally, the last two can be determined on a purely theoretical basis, but since the probability of EE usually depends on other hypotheses of unknown veracity, the application is not always so simple.)

Applications

In quantum physics

In quantum mechanics, the collapse of the wavefunction may be seen as a generalization of Bayes's Rule to quantum probability theory. This is key to the Bayesian interpretation of quantum mechanics.

Last revised on February 7, 2024 at 09:30:04. See the history of this page for a list of all contributions to it.