1 / 71

Statistical Theory; Why is the Gaussian Distribution so popular?

Statistical Theory; Why is the Gaussian Distribution so popular?. Rob Nicholls MRC LMB Statistics Course 2014. Contents. Continuous Random Variables Expectation and Variance Moments The Law of Large Numbers (LLN) The Central Limit Theorem (CLT).

zlata
Download Presentation

Statistical Theory; Why is the Gaussian Distribution so popular?

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Statistical Theory;Why is the Gaussian Distributionso popular? Rob Nicholls MRC LMB Statistics Course 2014

  2. Contents Continuous Random Variables Expectation and Variance Moments The Law of Large Numbers (LLN) The Central Limit Theorem (CLT)

  3. A Random Variable is an object whose value is determined by chance, i.e. random events Probability that the random variable X adopts a particular value x: : discrete : continuous Continuous Random Variables

  4. Continuous Uniform Distribution: Probability Density Function: Continuous Random Variables

  5. Example: Continuous Random Variables

  6. Example: Continuous Random Variables

  7. Example: Continuous Random Variables

  8. Example: Continuous Random Variables

  9. Example: Continuous Random Variables

  10. Example: Continuous Random Variables In general, for any continuous random variable X:

  11. : discrete • : continuous Continuous Random Variables • “Why do I observe a value if there’s no probability of observing it?!” • Answers: • Data are discrete • You don’t actually observe the value – precision error • Some value must occur… even though the probability of observing any particular value is infinitely small

  12. Continuous Random Variables For a random variable: The Cumulative Distribution Function (CDF) is defined as: (discrete/continuous) Properties: Non-decreasing

  13. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  14. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  15. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  16. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  17. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  18. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  19. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  20. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  21. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  22. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  23. Continuous Random Variables Probability Density function: Cumulative Distribution function: Boxplot:

  24. Continuous Random Variables Cumulative Distribution Function (CDF): Discrete: Continuous: Probability Density Function (PDF): Discrete: Continuous:

  25. Expectation and Variance Motivational Example: Experiment on Plant Growth (inbuilt R dataset) - compares yields obtained under different conditions

  26. Expectation and Variance Compare means to test for differences Consider variance (and shape) of the distributions – help choose appropriate prior/protocol Assess uncertainty of parameter estimates – allow hypothesis testing Motivational Example: Experiment on Plant Growth (inbuilt R dataset) - compares yields obtained under different conditions

  27. Expectation and Variance Compare means to test for differences Consider variance (and shape) of the distributions – help choose appropriate prior/protocol Assess uncertainty of parameter estimates – allow hypothesis testing Motivational Example: Experiment on Plant Growth (inbuilt R dataset) - compares yields obtained under different conditions • In order to do any of this, we need to know how to describe distributions • i.e. we need to know how to work with descriptive statistics

  28. Expectation and Variance Discrete RV: Sample (empirical): (explicit weighting not required) Continuous RV:

  29. Expectation and Variance Normal Distribution:

  30. Expectation and Variance Normal Distribution:

  31. Expectation and Variance Standard Cauchy Distribution: (also called Lorentz)

  32. Expectation and Variance Linearity: Expectation of a function of random variables:

  33. Expectation and Variance X ~ N(0,1) Variance:

  34. Expectation and Variance X ~ N(0,1) Variance:

  35. Expectation and Variance X ~ N(0,1) X ~ N(0,2) Variance:

  36. Expectation and Variance X ~ N(0,1) X ~ N(0,2) Population Variance: Unbiased Sample Variance: Variance:

  37. Standard deviation (s.d.): Expectation and Variance Non-linearity: Variance:

  38. Standard deviation (s.d.): Expectation and Variance Non-linearity: Variance:

  39. Standard deviation (s.d.): Expectation and Variance Non-linearity: Variance:

  40. Standard deviation (s.d.): Expectation and Variance Non-linearity: Variance:

  41. Standard deviation (s.d.): Expectation and Variance Non-linearity: Variance:

  42. Expectation and Variance Often data are standardised/normalised Z-score/value: Example:

  43. Moments Shape descriptors Li and Hartley (2006) Computer Vision Saupe and Vranic (2001) Springer

  44. Moments Shape descriptors Li and Hartley (2006) Computer Vision Saupe and Vranic (2001) Springer

  45. Moments Shape descriptors Li and Hartley (2006) Computer Vision Saupe and Vranic (2001) Springer

  46. Moments : mean : variance Moments provide a description of the shape of a distribution Raw moments Central moments Standardised moments : skewness : kurtosis

  47. Moments Standard Normal: Standard Log-Normal:

  48. Moments • Alternative representation of a probability distribution. Moment generating function (MGF):

  49. Moments • Alternative representation of a probability distribution. Moment generating function (MGF): • Example:

  50. Moments • Characteristic function always exists: However, MGF only exists if E(Xn) exists • Related to the probability density function via Fourier transform • Example:

More Related