1 / 19

PROBABILITY AND STATISTICS FOR ENGINEERING

PROBABILITY AND STATISTICS FOR ENGINEERING. Hossein Sameti Department of Computer Engineering Sharif University of Technology. Two Random Variables . Introduction. Expressing observations using more than one quantity height and weight of each person

presta
Download Presentation

PROBABILITY AND STATISTICS FOR ENGINEERING

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Two Random Variables

  2. Introduction • Expressing observations using more than one quantity • height and weight of each person • number of people and the total income in a family

  3. Joint Probability Distribution Function • Let X and Y denote two RVs based on a probability model (, F, P). Then: • What about • So, Joint Probability Distribution Function of X and Y is defined to be

  4. Properties(1) • Since • Since Proof

  5. Properties(2) • for • Since this is union of ME events, • Proof of second part is similar. Proof

  6. Properties(3) • So, using property 2, we come to the desired result. Proof

  7. Joint Probability Density Function (Joint p.d.f) • By definition, the joint p.d.f of X and Y is given by • Hence, • So, using the first property,

  8. Calculating Probability • How to find the probability that (X,Y) belongs to an arbitrary region D? • Using the third property,

  9. Marginal Statistics • Statistics of each individual ones are called Marginal Statistics. • marginal PDF of X, • the marginal p.d.f of X. • Can be obtained from the joint p.d.f. Proof

  10. Marginal Statistics Using the formula for differentiation under integrals, taking derivative with respect to x we get: Proof

  11. Let • Then: Differentiation Under Integrals

  12. Marginal p.d.fs for Discrete r.vs • X and Y are discrete r.vs • Joint p.d.f: • Marginal p.d.fs: • When written in a tabular fashion, to obtain one needs to add up all entries in the i-th row. • This suggests the name marginal densities.

  13. Example • Given marginals, it may not be possible to compute the joint p.d.f. • Obtain the marginal p.d.fs and for: Example

  14. Example Solution • is constant in the shaded region • We have: So: • Thus c = 2. Moreover, • Similarly, • Clearly, in this case given and , it will not be possible to obtain the original joint p.d.f in

  15. Example Example • X and Y are said to be jointly normal (Gaussian) distributed, if their joint p.d.f has the following form: • By direct integration, • So the above distribution is denoted by

  16. Example - continued • So, once again, knowing the marginals alone doesn’t tell us everything about the joint p.d.f • We will show that the only situation where the marginal p.d.fs can be used to recover the joint p.d.f is when the random variables are statistically independent.

  17. Independence of r.vs Definition The random variables X and Y are said to be statistically independent if the events and are independent events for any two Borel sets A and B in x and y axes respectively. • For the events and if the r.vs X and Y are independent, then • i.e., • or equivalently: • If X and Y are discrete-type r.vs then their independence implies

  18. Independence of r.vs Procedure to test for independence • Given • obtain the marginal p.d.fs and • examine whether independence condition for discrete/continuous type r.vs are satisfied. • Example: Two jointly Gaussian r.vs as in (7-23) are independent if and only if the fifth parameter

  19. Example Given Determine whether X and Y are independent. Similarly In this case and hence X and Y are independent random variables. Solution

More Related