Jump to content

Statistical economics/Common Probability Density Functions

From Wikiversity

Probability distributions can be broken up into categories based on the continuity of the variables involved. This page breaks up these distributions by their use of discrete or continuous random variables.

General Notation

[edit | edit source]

Here are some notations used throughout this page:

  • P(X=x) is the probability that the random variable X takes on the value x.
  • E[X] is the expected value of the random variable X, and is equal to ∑xxp(x) for discrete random variables and ∫xxp(x)dx for continuous variables.
  • var(X) is the variance of the random variable X, and is a measure of the spread of the possible values of the variable. If X takes on a large range of values, then the variance is larger than if X only takes on a values relatively close to each other.

Probability Distributions of Discrete Random Variables

[edit | edit source]

Some outcomes only take on discrete values, commonly integers (but not always). These outcomes can be modeled by discrete random variables that can only take on those values, and which values appear with probabilities determined by the probability distribution that the random variable is characterized by. Examples of discrete outcomes are the number of cars passing a landmark each day, the number of customers buying more than $50 each day, or simply the number of heads that show up during a coin tossing contest.

Notes for Discrete Random Variables:

  • p(x) is the probability that X takes on the value x (i.e., P(X=x)). This is commonly referred to as the Probability Mass Function (PMF) for discrete random variables.

The Bernoulli Distribution

[edit | edit source]

This is possibly the simplest probability distribution, with only two possible outcomes: success or failure. A common example of a Bernoulli random variable is a coin toss. A Bernoulli distribution is described by the parameter p, which is the probability of success. Naturally, (1−p) is the probability of failure (if we were hoping for the coin to land on heads, this would be the probability that it lands on tails instead).

Notation

[edit | edit source]

If a random variable X follows a Bernoulli distribution, it can be denoted by X∼Bernoulli(p), where p is the probability of success or the favorable outcome. Conventionally, since this is a binary variable, we say that the result is a success when X=1, and a failure if X=0.

Distribution Details

[edit | edit source]
  • p(1)=p,p(0)=1−p
  • X∈{0,1}
  • E[X]=p
  • var(X)=p(1−p)


The Binomial Distribution

[edit | edit source]

A Binomial random variable X can take on integer values from 1 to n, where n is the total number of identical trails, and X is the number of successful trials. This means that X can be understood as a sum of n Binomial random variables, each with probability p of success, where each Binomial random variable is the success or failure (1 or 0) of each individual trial. A common example of a Binomial random variable is the number of heads that result from flipping a coin n times, with the probability p of landing on heads.

Notation

[edit | edit source]

If a random variable X follows a Binomial distribution, it can be denoted by X∼Binomial(n,p) or X∼B(n,p), where n is the number of trials and p is the probability of success of the favorable outcome for each trial.

Distribution Details

[edit | edit source]
  • p(x)=(nx)px(1−p)n−x
  • X∈{0,1,2,...,n}
  • E[X]=np
  • var(X)=np(1−p)


The Geometric Distribution

[edit | edit source]

Notation

[edit | edit source]

If a random variable Y follows a Geometric distribution, it can be denoted by Y∼Geometric(p), where p is the probability of success of the favorable outcome.

Distribution Details

[edit | edit source]
  • p(y)=(1−p)y−1p
  • Y∈{1,2,3,...}
  • E[Y]=1p
  • var(Y)=1−pp2


The Negative Binomial Distribution

[edit | edit source]

Notation

[edit | edit source]

If a random variable X follows a Negative Binomial distribution, it can be denoted by X∼NB(r,p), where r is the number of desired successes and p is the probability of success of the favorable outcome.

Distribution Details

[edit | edit source]
  • p(y)=(y−1r−1)pr(1−p)y−r
  • Y∈{r,r+1,r+2,...}
  • E[Y]=rp
  • var(Y)=r(1−p)p2


The Poisson Distribution

[edit | edit source]

Notation

[edit | edit source]

If a random variable Y follows a Poisson distribution, it can be denoted by X∼Pois(λ), where λ is mean of the variable.

Distribution Details

[edit | edit source]
  • p(y)=λyy!e−λ
  • Y∈{0,1,2,...}
  • E[Y]=λ
  • var(Y)=λ


The Hypergeometric Distribution

[edit | edit source]

Notation

[edit | edit source]

If a random variable Y follows a Hypergeometric distribution, it can be denoted by X∼Hypergeometric(N,n,r), where N is the total size of the population, n is the size of the sample taken, and r is the number of favorable objects in the population.

Distribution Details

[edit | edit source]
  • p(y)=(ry)(N−rn−y)(Nn);y≤r;n−y≤N−r
  • Y∈{0,1,...,n}
  • E[Y]=nrN
  • var(Y)=n(rN)(N−rN)(N−nN−1)


The Uniform Distribution

[edit | edit source]

Notation

[edit | edit source]

If a random variable X follows a Uniform distribution, it can be denoted by X∼Unif(N), where N is the total number of outcomes. A uniform distribution has equal probability over all possible outcomes, which is simply p=1N.

Distribution Details

[edit | edit source]
  • X∈{set of all possible outcomes}

If the set of outcomes contains only consecutive integers starting at 1, then:

  • E[X]=n+12
  • var(X)=n2−112


Probability Distributions of Continuous Random Variables

[edit | edit source]

Notes for Discrete Random Variables:

  • f(x) is the probability density value that X takes on the value x. This is commonly referred to as the Probability Density Function (PDF) for continuous random variables. For continuous variables, since any range of real numbers has infinitely many numbers in it, the probability of X taking on any single number is 0. For continuous random variables, we instead ask about the probability that X will fall within some range of numbers. To get this probability, we define f(x) as a density function that gives us probability when integrated. In other words, the probability that X is between the real numbers a and b is P(a<X<b)=P(a≤X≤b)=∫abf(x)dx.

The Uniform Distribution

[edit | edit source]

The Normal Distribution

[edit | edit source]

The Poisson Scatter Distribution

[edit | edit source]

The Exponential Distribution

[edit | edit source]

The Gamma Distribution

[edit | edit source]

The Chi-square Distribution

[edit | edit source]

The Beta Distribution

[edit | edit source]

The Distribution

[edit | edit source]