Conditional Probability
Introduction
[edit | edit source]Conditional Probability, in probability theory, measures the chance of the occurrence of an event given (or based upon assumption) that another event has already happened.
Bayes' Theorem
[edit | edit source]Named after Thomas Bayes, Bayes' Theorem calculates conditional probability by using known related probability variables. Specifically, the theorem states that the probability of event A occurring given that event B has already occurred is equal to the probability of event A multiplied by the probability of event B occurring given that event A has occurred divided by the probability of event B.
for A and B are events; .
Proof of Theorem
[edit | edit source]The general conditional probability proof uses the probability of both events A and B occurring and divides it by its condition, event B, i.e. the intersection of events A and B scaled by the known variable event B (events A and B are dependent).
for A and B are events; .
for A and B are events; .
Therefore,
for A and B are events; .
for A and B are events; .
The two equations can be substituted back into the two on top, which will result in Bayes' Theorem.
Application
[edit | edit source]Bayes' Theorem is prominent in scientific discovery and machine learning. It allows conditional probabilities to accommodate new evidence in that new evidence will further restrict the prior hypothesis. The theorem will also account for the varying levels of influence the new evidence will have on events A and B respectively.