680 likes | 1.1k Views
Probability and Probability Distribution. Dr Manoj Kumar Bhambu GCCBA-42, Chandigarh M- +91-988-823-7733 mkbhambu@hotmail.com. Objectives of Learning this Unit.
E N D
Probability and Probability Distribution DrManoj Kumar Bhambu GCCBA-42, Chandigarh M- +91-988-823-7733 mkbhambu@hotmail.com
Objectives of Learning this Unit Probability and Probability Distribution: Definitions- Probability Rules –Application of Probability Rules-Conditional Probability- Bayes theorem Random Variable and Probability Distributions; BinomialDistribution- Poisson Distribution and Normal Distribution.
Probability: Meaning • A probability is a quantitative measure of uncertainty – a number that conveys the strength of our belief in the occurrence of an uncertain event. • Probability is a measure of uncertainty of events in a random experiment.
Types of Experiment • Deterministic Experiment: Experiments that have fixed outcome or result no matter any number of times they are repeated • Random Experiment: if an experiment, when repeated under identical conditions, do not produce the same outcome every time but the outcome in a trial is one of the several possible outcomes then such an experiment is known as random or probabilistic experiment.
Basic Terms in Probability A Random Experimentis any situation whose outcome cannot be predicted with certainty. Examples of an experiment include rolling a die, flipping a coin, and choosing a card from a deck of playing cards. By an outcome or simple eventwe mean any result of the experiment. For example, the experiment of rolling a die yields six outcomes, namely, the outcomes 1,2,3,4,5, and 6.
Examples of ‘Outcomes’ If you toss a coin you have an equal chance of getting a head or a tail. Heads or tails are the ‘outcomes’. If a baby is born it has an equal chance of being a boy or a girl. Boy or girl are the ‘outcomes’. If you roll a dice you have an equal chance of getting the number 1, 2, 3, 4, 5 or 6! These scores are the ‘outcomes’.
Basic Terms in Probability (con.) The sample space S of an experiment is the set of all possible outcomes for the experiment. For example, if you roll a die one time then the experiment is the roll of the die. A sample space for this experiment could be S = {1, 2, 3, 4, 5, 6} where each digit represents a face of the die. Discrete Sample Space: A sample space whose elements are finite or infinite but countable is called Discrete Sample Space Continuous Sample Space: A Sample Space whose elements are infinite and uncountable or assume all the values on a real line R or on an intervals of R is called a Continuous Sample Space.
Event: An event is a subset of the sample space. For example, the event of rolling an odd number with a die consists of three simple events {1, 3, 5}. Null Event: An event having no sample point is called a Null Event and is denoted by Φ. Simple Event: An event consisting of only one sample point of a sample space is called a simple event. Compound Events: When an event is decomposable into a number of simple events, then it is called a compound event. Exhaustive Events: It is the total number of all possible outcomes of an experiment.
Mutually Exclusive Events: If in an experiment the occurrence of an event prevents or rules out the happening of all other events in the same experiment, then these events are said to be mutually exclusive events. Equally Likely Events: The outcomes of an experiment are equally likely to occur when the probability of each outcome is equal. Collectively Exhaustive Events : The total number of events in a population exhausts the population. So they are known as collectively exhaustive events. Favourable cases: The cases which ensures the occurrence of an event are said to be favourable cases to the event.
Independent and Dependent Events When an experiment is conducted in such a way that the occurrence of event neither effect the occurrence of another event nor is effected by the occurrence of another event, both the events are called independent events. Events which are not independent are called dependent events
Mathematical Vocabulary We can describe the probability or chance of an event happening by saying: It is IMPOSSIBLE. It is UNLIKELY. It is LIKELY. It is CERTAIN.
Classical Definition of Probability • If an experiment has nmutually exclusive, equally likely and exhaustive cases, out of which m are favourable to the happening of event A, then the probability of the happening of A is denoted by P(A) and is defined as: P(A) = = • Probability of an event which is certain to occur is 1 and the probability of an event impossible is zero. • The probability of occurrence of any event lies between 0 and 1, both inclusive
Example 1 What is the probability of getting an even number in a single throw of a dice. Answer: The possible cases in the throw of a dice are six viz. 1, 2, 3, 4, 5, 6. Favourable cases are those which are marked with 2, 4, and 6. ∴ Probability of getting an even no = = =
More Examples • What is the probability of getting tail in a throw of a unbiased coin? • A bag contains 6 white balls and 9 black balls. What is the probability of drawing a black ball in a single draw? • What is the probability when a card is drawn at random from an ordinary pack of cards, if it is (i) a red card; (ii) a club; (iii) one of the court cards? • What is the probability of throwing a number greater than 3 with an ordinary dice? • What is the probability that a leap year selected at random will have 53 Sundays? • What is the probability of getting a total of more than 10 in a single throw of two dice?
Statistical or Empirical definition of Probability “ if the experiment be repeated a large number of times under essentially identical conditions, the limiting value of the ratio of the number of times the event A happens to the total number of trials of the experiments as the number of trials increases indefinitely is called the probability of happening of the event A.” -Von Mises Symbolically, Let P(A) denote the probability of occurrence of event A, m be the number of times in which the event A occurs in a series of n trials then P(A)= provided the limit is finite and unique
Modern Definition of Probability Definition. A probability function P on a finite sample space Ω assigns to each event A in Ω a number P(A) in [0,1] such that (i) P(Ω) = 1, and (ii) P(A ∪ B) = P(A) + P(B) if A and B are disjoint. The number P(A) is called the probability that A occurs.
Theorems on Probability There are two important theorems of probability, namely Addition Theorem or Theorem on Total Probability Multiplication Theorem or Theorem on Compound Probability
Addition Theorem • Statement: If n events are mutually exclusive, then the probability of happening of any one of them is equal to the sum of the probabilities of the happening of the separate events. In other words, if , …….. be n events and P(), P(), P(), …….P(), be their respective probabilities, then P(……..+ )=P((+……..+P( )
Proof: Let , …….. be mutually exclusive events with probabilities P(), P(), P(), …….P() respectively. Let N be the total number of trials. Let , …….. be the cases favourable to events , …….. respectively, then P() =, i= 1, 2, ………, n. Since the events , …….. are mutually exclusive, therefore, the cases favourable to the happening of any one of the events , …….. are , …….. Hence the probability of happening of any one of the events , …….. is P(+……..+ ) = = + + ...... + =P((+……..+P( )
Example • A dice is rolled. What is the probability of getting a 1 or 6? • Answer: Let , be the event of getting a 1 and 6 respectively when a dice is rolled. Here P()= P() = ∴ P(+ = P()P() ( By Addition Theorem) = + = =
Example • If the probability of horse A winning the race is and the probability of horse Bwinning the race is , what is the probability that one of the horse will win the race? • Answer: Let , be the event of winning the race by horse A and horse B respectively. Here P()= P() = ∴ P(+ = P()P() ( By Addition Theorem) = + = =
EXAMPLES ILLUSTRATING THE APPLICATION OF THE ADDITION THEOREM Question: A card is drawn from a pack of 52 cards. What is the probability of getting either a king or a queen? Solution: There are 4kings and 4 queens in a pack of 52 cards. The probability of drawing a king card is P (K) = and the probability of drawing a queen card is P (Q) = Since, both the events are mutually exclusive, the probability that the card drawn is either a king or a queen is P (K or Q) = P (K) + P (Q) ( By Addition Theorem) = + = =
More Example Question :A card is drawn at random from a pack of cards. Find the probability that the drawn card is either a club or an ace of diamond. Solution :Probability of drawing a club P (A) = Probability of drawing an ace of diamond P (B) = P (A or B) = P (A) + P (B) (By Addition Theorem) + = =
Question: An investment consultant predicts that the odds against the price of a certain stock will go up during the next week are 2 : 1 and the odds in favour of the price remaining the same are 1 : 3. What is the probability that the price of the stock will go down during the next week. Solution: Let A denote the event ‘stock price will go up’, and B be the event ‘stock price will remain same’. Then P (A) = , and P (B) = P (stock price will either go up or remain same) = P (A U B) P (A) + P (B) = + = Now, P (stock price will go down) = 1 – P (A U B) = 1 - =
ADDITION THEOREM FOR NOT MUTUALLY EXCLUSIVE EVENTS Two or more events are known as partially overlapping if part of one event and part of another event occur together. Thus, when the events are not mutually exclusive the addition theorem has to be modified. Modified Addition Theorem states that if A and B are not mutually exclusive events, the probability of occurrence of either A or B or both is equal to the probability of that event A occurs, plus the probability that event B occurs minus the probability that events common to both A and B occur simultaneously. Symbolically, P (A or B or Both ) = P (A) + P (B) – P (AB) The following figure illustrates this point: NOT MUTUALLY EXCLUSIVE EVENTS A B AB Overlapping Events
Generalization The theorem can be extended to three or more events. If A, B and C are not mutually exclusive events, then P (Either A or B or C) = P (A) + P (B) + P (C) – P (AB) – P (AC) – P (BC) + P (ABC) EXAMPLES ILLUSTRATING THE APPLICATION OF THE MODIFIED ADDITION THEOREM Question: A card is drawn at random from a well shuffled pack of cards. What is the probability that it is either a spade or a king ? Solution: The Probability of drawing a spade P (A) = The Probability of drawing a King P (B) = The Probability of drawing a King of Spade P (AB) = P ( A or B or Both) = P (A) + P (B) – P (AB) = + - = =
Question: A bag contains 30 balls number from 1 to 30. One ball is drawn at random. Find the probability that the number of ball is a multiple of 5 or 6. Solution: Probability of the ball being a multiple of 5 P (A) = Probability of the ball being a multiple of 6 P (B) = Since, 30 is a multiple of 5 as well as 6, therefore the events are not mutually exclusive. P (A and B) = (common multiple 30) P (A or B) = P (A) + P (B) – P (AB) = + - =
MULTIPLICATION THEOREM: Independent Events The Multiplication Theorem states that if A and B are two independent events, then the probability of the simultaneous occurrence of A and B is equal to the product of their individual probabilities. Symbolically, P (AB) = P (A) X P (B) Let be the number of cases favourable to the happening of the event A out of exhaustive and equally likely cases. P (A) = Let be the number of cases favourable to the happening of the event B out of exhaustive and equally likely cases. P (B) = Now, by the Fundamental Principle of counting , the number of cases favourable to the happening of the event AB is out of P (AB) = P (AB) = P (A).P (B) Hence, the theorem is proved.
Generalisation The theorem can be extended to three or more independent events. If A, B and C are three independent events, then P (ABC) = P (A) x P (B) x P (C) EXAMPLES ILLUSTRATING THE APPLICATION OF THE MULTIPLE THEOREM Question: A coin is tossed three times. What is the probability of getting all the three heads? Solution: Probability of head in the first toss P (A) = Probability of head on the second toss P(B) = Probability of head on the third toss P(C) = P (ABC) = P (A) x P (B) x P(C) = x x =
Question: From a pack of 52 cards, two cards are drawn at random one after the another with replacement. What is the probability that both cards are kings? Solution: The probability of drawing a King P (A) = The probability of drawing again a king after replacement P (B) = P (AB) = P (A) x P (B) = x =
Probability of happening of atleast one event in case of n independent events P (happening of at least one of the events) = 1 – P (happening of none of the events)
Question: A problem in statistics is given to three students. A, B and C whose chances od solving it are ½, 1/3 and ¼. What is the probability that the problems will be solved? Solution: Probability that A will solve the problem = P (A) = Probability that B will solve the problem = P (B) = Probability that C will solve the problem = P (C) = Probability that A will not solve the problem = P ( ) = 1 - = Probability that B will not solve the problem = P ( ) = 1 - = Probability that C will not solve the problem = P ( ) = 1 - = P (that none will solve the problem) = P ( ).P ( ).P ( ) = x x = P (that problem will be solved) = 1 – P (that none will solve) = 1 - =
Question: A candidate (Mr. X) is interviewed for 3 posts. For the first post, there are 3 candidates, for the second post, there are 4 and for the third there are 2. What are the chances of Mr. X being selected ? Solution : Probability of selection for 1st post = P (A) = Probability of selection for 2nd post = P (B) = Probability of selection for 3rd post = P (C) = Probability of not getting selected for 1st post = P () = 1 - = Probability of not getting selected for 2nd post = P () = 1 - = Probability of not getting selected for 3rd post = P () = 1 - = P () = P ( ).P ( ).P ( ) = x x = Probability of selection for at least 1 post = 1 – P (not selected at all) = 1 - =
CONDITIONAL PROBABILITY Dependent events are those in which the occurrence of one event affects the probability of other events. The probability of the event B given that A has occurred is called conditional probability of B. It is denoted by P (b/A). Similarly, the conditional probability of A given that B has occurred is denoted by P (A/B). If A and B are two dependent events, then the conditional probability of B given A is defined and given by: P (B/A) = provided P (A) > 0 Similarly, the conditional probability of A given B is defined and given by: P (A/B) = provided P (B) > 0
MULTIPLICATION THEOREM IN CASE OF DPENDENT VARIABLES When the events are not independent, i.e., they are dependent events, then the multiplication theorem has to be modified. The Modified Multiplication Theorem states that if A and B are two dependent events, then the probability of their simultaneous occurrence is equal to the probability of one event multiplied by the conditional probability of the other. P (AB) = P (A) . P (B/A) OR P (AB) = P (B) . P (A/B) Where, P (B/A) = Conditional Probability of B given A. P (A/B) = Conditional Probability of A given B.
EXAMPLES ILLUSTRATING THE APPLICATION OF THE MODIFIED MULTIPLICATION THEOREM Question: A bag contains 10 white and 5 black balls. Two balls are drawn at random one after the other without replacement. Find the probability that both balls drawn are black. Solution: The probability of drawing a black ball in the first attempt is: P (A) = = The probability of drawing the second black ball given that the first drawn is black and not replaced is: P (B/A) = = Since, the events are dependent, so the probability that both balls drawn are black is: x =
Question: Find the probability of drawing a king, a queen and a knave in that order from a pack of cards in three consecutive draws, the cards drawn not being replaced. Solution: The probability of drawing a king = P (A) = The probability of drawing a queen after a king has been drawn P (B/A) = The probability of drawing a knave after a king and a queen have been drawn P (C/AB) = P (ABC) = x x =
COMBINED USE OF ADDITION AND MULTIPLICATION THEOREM Question: A speaks truth in 80% cases, B in 90% cases. IN what percentage of cases are they likely to contradict each other in stating the same fact. Solution: Let P (A) and P (B) denote the probability that A and B speak the truth. Then, P (A) = = P () = 1 – P (A) = 1 - = P (B) = = P ( ) = 1 – P (B) = 1 - = They will contradict each other only when one of them speaks the truth and the other speaks a lie. Thus, there are two possibilities: (i) A Speaks the truth and B tells a lie (ii) B Speaks the truth and A tells a lie. P (A) = x = P (B)= x = Required Probability = + =
Question: A bag contains 5 white and 3 red balls and four balls are successively drawn out and not replaced. What is the chance that they are alternatively of different colours? Solution: 4 balls of alternative colours can be either White, Red, White, Red or Red, White, Red, White Beginning with White Ball: The probability of drawing a white ball = The probability of drawing a red ball = The probability of drawing a white ball = The probability of drawing a red ball = P (1W 1R 1W 1R) = x x x =
Beginning with Red Ball: The probability of drawing a red ball = The probability of drawing a white ball = The probability of drawing a red ball = The probability of drawing a white ball = P (1R 1 W 1R 1W) = x x x = Required Probability = + =
Permutation • A Permutation is an arrangement in a definite order of n objects taken r at a time. nPr = n (n-1) (n-2)….(n-r+1) = 0 < r ≤ n and n! = n (n-1) (n-2)………3.2.1 Where repetition is not allowed. nPr = where repetition is allowed. • The number of permutation of n objects where p objects are of same kind and rest are different = • The number of permutation of n objects where objects are of one kind, objects are of one kind….. objects are of one kind and rest if any are different =
Find the number of permutations of the letters of the word ALLHABAD. Here Total no of Letters = 9 A’s or = 4 L’s or = 2 Required No. = = = = = 7560 • How many 4-digit numbers can be formed by using the digits 1 to 9 if (1) repetition is allowed (2) repetition is not allowed. when repetition is allowed nPr = = = 9999= 6561 when repetition is not allowed nPr = = ==3024
Find the number of permutations of the letters of the word ALLHABAD. Here Total no of Letters = 9 A’s or = 4 L’s or = 2 Required No. = = = = = 7560 • How many 4-digit numbers can be formed by using the digits 1 to 9 if (1) repetition is allowed (2) repetition is not allowed. when repetition is allowed nPr = = = 9999= 6561 when repetition is not allowed nPr = = ==3024
Combination • A Combination is an arrangement of n objects taken r at a time. nCr = n (n-1) (n-2)….(n-r+1)/ r! = 0 < r ≤ n and n! = n (n-1) (n-2)………3.2.1 • Note : Order is not important in case of combination
Example A committee of 3 persons is to be constituted from a group of 2 men and 3 women. What is the probability that the committee would consist of 1 man and two women. Total Persons = 2+3 = 5 3 persons can be chosen out of 5 = 5C3 = = 10 ways 1 man can be chosen out of 2 = 2C1= = 2 ways 2 Women can be chosen out of 3 = 3C2= = 3 ways Required Probability = = =
BERNOULLI’S THEOREM IN THE THEORY OF PROBABILITY Bernoulli’s theorem is very useful in working out various probability problems. This theorem states that if the probability of happening of an event on one trial or experiment is known, then the probability of its happening exactly, 1,2,3,…r times in n trials can be determined by using the formula: P (r) = nCrpr . qn-r r = 1,2,3,…n Where, P (r) = Probability of r successes in n trials. p = Probability of success or happening of an event in one trial. q = Probability of failure or not happening of the event in one trial. n = Total number of trials.
Example A Box of 9 golf gloves contains 2 left-handed and 7 right handed. If 2 gloves are randomly selected that both gloves are of (i) of same hand (ii) of right hand (iii) of both hand. (i) P(LL or RR) = += + = = (ii) P(RR)= = = (iii) P (Both Hands) =( ×) + ( ×) =( × )+ (×) =
EXAMPLES ILLUSTRATING THE APPLICATION OF BERNOULLI’S THEOREM Question: Three coins are tossed simultaneously. What is the probability that there will be exactly two heads? Solution: P (r) = = nCrpr . qn-r Given, n = 3, r = 2, p = probability of head in throw of a coin = q = 1 - = P (2H) = 3C2 () 2 . 3-2 = x = 3 x =
BAYE’S THEOREM Bayes' Theorem is named after the British Mathematician Thomas Bayes and it was published in the year 1763. With the help of Bayes' Theorem, prior probability are revised in the light of some sample information and posterior probabilities are obtained. This theorem is also called Theorem of Inverse Probability. STATEMENT OF BAYE’S THEOREM If A1 and A2 are mutually exclusive and exhaustive events and B be an event which can occur in combination with A1 and A2, then the conditional probability for event A1 and A2 given the event B is given by: P (A1/B) = Similarly, P (A2/B) =