Discrete Random Variables If the set of all possible values of the random variable is either finite or countably infinite , then the random variable is discrete. A discrete random variable is an rv whose possible values either constitute a finite set or else can be listed in an infinite sequence in which there is a first element, a second element, and so on.
Continuous Random Variables If the set of all possible values of the random variable is an interval , then the random variable is continuous. A random variable is continuous if its set of possible values consists of an entire interval on the number line. No matter how small the range, the number of possible values for X is always ( uncountably ) infinite
Common Distributions Common discrete distributions: • generic discrete • Bernoulli • binomial • geometric • Poisson • Common continuous distributions: • uniform • step • triangular • exponential • normal • lognormal • gamma • Student t • F • beta • Weibull
REVIEW OF PROBABILITY THEORY Probability is the measure of the likeliness that an event will occur.
Probability Mass Function (Discrete)
Probability Mass Function (Discrete) Pmf describes how the total probability mass of 1 is distributed at various points along the axis of possible values of the random variable (where and how much mass at each x).
Cumulative Distribution Function Die Example
Cumulative Distribution Function
Probability Density Function (Continuous)
Probability Density Function (Continuous)
Probability Density Function (Continuous)
Probability Density Function (Continuous)
PDF Continued
Cumulative Distribution Function
Sample Derivation: Uniform CDF
Inverse CDF
Inverse CDF
Inverse CDF
Sampling from a Probability Distribution
Exponential Distribution A random variable, , with an exponential distribution is widely used to model “random” arrivals in continuous time, especially when the inter-arrival times are iid (e.g., customer inter-arrivals, times to failure, etc.) λ = arrival rate (0.2 emergency calls are arriving in one hour). X~ Expo ( λ ) The state space is S = {0, ∞] µ = 1/ λ , (average response time of an ambulance is equal to 5 hours). variance = 1/ λ² A sequence or other collection of random variables is independent and identically distributed ( iid ) if each random variable has the same probability distribution as the others and all are mutually independent
Sample Derivation: Exponential CDF X is sample and F(x) is rand function in excel
Normal Distribution CDF * If cumulative is TRUE, NORMDIST returns the CDF; if FALSE, it returns the pmf .
Example: Exponential Distribution
Exponential Distribution: Spreadsheet Simulation
Exponential Distribution: Histogram of RAND generated by excel
Exponential Distribution: Histogram of generated samples
Example: Normal Distribution
Normal Distribution: Spreadsheet Simulation
Normal Distribution: Histogram of generated samples
BETA Distribution: Overview
BETA Distribution: Overview
BETA Distribution: Some Formulas
BETA Distribution: Spreadsheet Simulation
Triangular Distribution Alternative for Beta distribution. Parameters of Beta distribution are not easily estimated and does not have a closed form for its cdf . Can be used even when data is limited. It is also called “lack of Knowledge” distribution. Widely used in Risk Analysis of disasters Project Management to model events which take place within an interval defined by a minimum and maximum value. Reference: The triangular distribution as a proxy for the beta distribution in risk analysis By DAVID JOHNSON, The Statistician (1997) 46, No. 3, pp. 387-398.
Triangular Distribution A random variable, , with a triangular distribution is used when it is assumed that the likelihood of values first increases linearly to some maximal value (mode ), and then decreases linearly
Triangular Distribution Triangular distribution can be expected to produce a distribution function, which is very similar to that of the beta distribution
Triangular Distribution
Triangular Distribution
Triangular Distribution The pdf is as follows:
Triangular Distribution The cdf is given by: The inverse cdf is as follows:
The Central Limit Theorem (CLT)
The Central Limit Theorem (CLT)
The Central Limit Theorem (CLT) Reference: Exploring Research by Neil Salkind , seventh edition
The Central Limit Theorem (CLT)
Simulation Example Arrival Rate= 1/ inter arrival time For example; If 12 customers enter a store per hour. Arrival rate is 12 customers per hour. The time between each arrival is; = 1/12= 0.083 hours= 5 minutes * The inter arrival time is the time between each arrival into the system arrival is 5 minutes.
Simulation Example
Exponential Distribution Rescue 211 Ambulance Example λ = arrival rate (0.2 emergency calls are arriving in one hour) µ = 1/ λ , (average response time of an ambulance is equal to 5 hours)