The addition rule
Consider two events A and B, such that they are a part of the sample space S. Let and be the probabilities of events A and B, respectively.
The Addition law of probability also referred to as the addition rule or the sum rule, states that the probability of both events occurring that is the union of A and B is given by
where denotes the probability of the occurrence of A or B, and denotes the probability of the occurrence of A and B.
We suppose that A and B are non-empty events and that their intersection is not the empty set.
To understand how the above formula is derived, let us visualize sets A and B as a part of a Venn diagram.
We recall that Venn Diagrams are diagrams where the sets and the sample space are depicted as geometric figures in order to better understand their unions, complements, and intersections.
Consider the Venn diagram below.
The Venn diagram of two events A and B, StudySmarter Originals
In the above diagram, the green rectangle represents the sample space, and the two blue circles represent events A and B respectively.
If we want to find the probability of the event "A or B", it will be their union, and we can use the Venn diagram to see how we can do it.
If we add the probabilities of A and B, their intersection will be counted twice, instead of once. Hence, we need to subtract the intersection of them. This gives us:
For any events, the word ‘and’ implies their ’intersection’ and the word ’or’ implies their ‘union’
The Addition rule can also be extended to three events, namely A, B and C,
where the same idea of Venn diagrams can be considered to derive the formula.
Given two events X and Y with probabilities of their occurrence are respectively 0.3 and 0.4. The probability of the occurrence of X and Y is 0.1, find the probability that X or Y occurs.
Solution
The probabilities of X and Y are given as and .
The probability of both of them occurring is .
We are asked to find the probability of X or Y which is nothing but the probability of their union.
Hence, we can use the Addition rule to find it,
Substituting the appropriate values, we get
Hence the probability of event X or Y happening is 0.6.
Addition rule for Disjoint events
It can be the case sometimes that two events have nothing to do with each other when their intersection is a null set.
Two events, A and B are called Disjoint events if their intersection is a null set that is
Now, in order to find the probability of the union of two disjoint events, we use the addition rule
Noting that A nd B are disjoint events, we have
Now plug in the value of their intersection, we have
This is tossed twice and the outcomes are noted, find the probability that the first outcome is 1 and the second outcome is an even number.
A dice is tossed twice and the outcomes are noted, find the probability that the first outcome is 1 and, the second outcome is an even number.
Solution
Note that 1 is not an even number, so the two events are disjoint in this case. The reason being that the outcomes of an even number appearing does not overlap with the outcome of 1 appearing on the first toss.
Let the two events be A and B respectively,
since 1 is an outcome of 6 possibilities, and,
since there are 3 even numbers from all the 6 possibilities.
We want to find . We use thus the addition formula for disjoint events as the occurrence of one event does not affect the occurrence of the other. Hence we have,
Thus, the probability of getting 1 on the first toss and an even number on the second toss is .
Product Rule
Using the concept of conditional probability, we can outline a formula for the Product rule. It is given as follows,
Verbally, ‘the probability of the occurrence of A and B is equal to the product of the probability of B occurred A and the probability of A itself’. We can also extend this law to three events, namely, A, B and C,
Similar expressions can be derived for as many events as one wants.
Consider the below example to understand how the occurrence of an event depends on the occurrence of a preceding event.
We consider 2 bags, an orange bag and a black bag. There are 4 candies in the orange bag and 5 candies in the black bag. There are also 2 chocolates in the orange bag and 3 chocolates in the black bag. A sweet is randomly chosen from any of the bags, what can be said about the probability that the chosen sweet is a candy?
Solution
Let A be the event that the chosen sweet is a candy and let B be the event that the candy was chosen from the orange bag. Let C be the event that the bag chosen was the black one.
We can see here that the probability of getting a candy depends on the bag we have chosen. If the sweet is chosen from the black bag, the probability is different if it was chosen from the orange bag.
Thetree diagram of all the events, StudySmarter Originals
Consider the above diagram, here all the possible events are branched in order to better understand the probabilities.
(i) If the sweet was chosen from the black bag, we say that the ‘probability of getting the candy given that it came from the orange box’ .
According to the events we defined, the probability of this event is denoted as and is read as ‘A given B has occurred’.
(ii) If the sweet was chosen from the orange box, the probability of getting a candy is denoted as and is read as ‘A given C has occurred’.
Let us revisit the example we saw earlier, and calculate the probability using the Product rule.
There are 2 bags, an orange bag and a black bag. There are 4 candies in the orange bag and 5 candies in the black bag. There are also 2 chocolates in the orange bag and 3 chocolates in the black bag. A sweet is randomly chosen, find the probability that the chosen sweet is a candy and it came from the black bag.
Solution
Let A be the event that the chosen sweet is a candy and let B be the event that the sweet was chosen from the orange bag. Let C be the event that the bag chosen was the black one.
The tree diagram signifying relevant conditional probabilities, StudySmarter Originals
We want to find the probability that the sweet chosen is a candy given that the bag is black, hence we want to find .
Using the product rule we have,
The probability that the sweet came from the black bag is
and the probability of choosing the black bag is 1/2 as there are only two bags,
Substituting these values, we get,
Hence, the probability that the sweet is a candy and it came from the black bag is .
Independent Events
Two events are Independent of each other is the occurrence of one does not affect the occurrence of another in any possible way.
This can be extended to any finite number of events as long as they do not affect the probability of each other. An important property of independent events can be expressed as a formula,
In other words, the probability of the intersection of two independent events is the product of the individual probabilities.
Jason and William are playing cards, Jason asks William to draw a random card. William draws a queen and puts it back in the deck. Jason asks him to draw another card and asks him the probability that this card is a king followed by the previous queen. What should be William’s answer?
Solution
Let A be the event that the card drawn is a queen and B be the second card drawn is a king.
One should note that it doesn’t matter what William chooses as his first card, both events are completely independent of each other.
Calculating the individual probabilities, we get
As there are four queens and four kings in a deck of 52 cards, we want to find the probability of the intersection of the two events, using the fact that the events are independent.
.
Are the following two events independent?
A : The rising of the sun
B : Tossing a coin and getting a head
Solution
YES They are!
Events A and B are independent as they are completely unrelated and the occurrence of one does not affect the other. The rising of the sun is without any doubt, independent of the outcome of flipping a coin.