Skip to lesson content

Lesson 4 of 5

Probability · Lesson 4 of 5

Reasoning Backward from Evidence

“Use priors and likelihoods to evaluate competing explanations of an observed result.”

Learning Objectives

• Translate evidence stories into clearly defined hypotheses and likelihoods. • Account for base rates and false positives in a hypothetical testing model. • Apply Bayes’ rule to production, transport, reporting, and sampling problems. • Combine repeated observations using independence conditional on a hypothesis. • Check posterior calculations using joint contributions and alternative cases.

What could have produced this result?

A positive result, a defective bolt, or a late arrival can have several explanations. The most familiar explanation is not automatically the most probable. Bayes’ rule asks how much probability each explanation contributes to the actual observation, taking both its starting frequency and its likelihood into account.

Begin by naming the observed event and the possible hypotheses . Translate the story into priors and likelihoods . Multiply each prior by its likelihood, add all those joint contributions, and divide the requested contribution by that total. Writing these four stages explicitly usually prevents reversal errors.

Rare conditions and positive results

A test can be good at detecting a condition and still produce many false positives in a population where the condition is rare. The two relevant groups can have very different sizes. A frequency table helps us see the denominators before using the formula.

Example — A hypothetical HIV testing model

Problem
In a mathematical model, of a population has HIV. A test is positive for of those with HIV and for of those without it. Given a positive result, calculate the model probability that the person has HIV.

  1. 1.Let mean has HIV and mean positive. The priors are , . The likelihoods are , .
  2. 2.The true-positive contribution is . The false-positive contribution is . Thus .
  3. 3.The posterior is . It is about within this stipulated model, not .
  4. 4.The describes positives among people with the condition. The posterior describes people with the condition among all positives. These are different groups. The numerical test properties here are assumptions of the problem.
A positive result can arise in two different ways100,000 people100 have condition99,900 do notPositive results90 true positives999 false positivesNegative results1098,901Among 1,089 positives, 90 have the condition: 90 / 1,089.
Count the two kinds of positive results— The large group without the condition contributes 999 false positives, compared with 90 true positives.
Keep the denominator group clear

False-positive probability is , the chance of a positive among those without the condition. It is not , the chance of being without the condition among positives. Neither can be substituted for the other without the prior information.

Tracing an item back to its source

When several machines feed one stockpile, output shares are the priors. Defect rates are likelihoods. A machine can have a high defect rate but make few defective items overall if it supplies only a small fraction of the output.

Example — Which machine made a defective bolt?

Problem
Machines A, B, and C supply of bolts, with defect rates . A randomly chosen bolt is defective. Find the probability that B made it.

  1. 1.Let identify the producing machine and mean defective. Form the joint contributions: , , and .
  2. 2.Their sum is . All three machine sources belong in the denominator.
  3. 3.For machine B, . Its posterior is about , larger than its output share because its defect rate exceeds the overall rate.
Example — A late arrival

Problem
A doctor uses train, bus, scooter, or another method with probabilities . The corresponding lateness probabilities are . Given a late arrival, find the probability of train travel.

  1. 1.The transport choices form the partition. The four lateness contributions are , , , and .
  2. 2.Add them using denominator : .
  3. 3.The train posterior is . Train lateness is the given likelihood; train given late is the requested posterior.

A reported result needs a reporting model

Evidence may be a statement rather than a physical measurement. Then we need probabilities for how a report is produced under each actual outcome. Merely knowing that someone sometimes lies does not specify how they choose among every possible false statement.

Example — A report of a six

Problem
A fair die is rolled. A reporter truthfully answers the yes-or-no question “Was it a six?” with probability , independently of the die result, and otherwise gives the opposite answer. Given a yes report, find the probability of an actual six.

  1. 1.Let mean actual six and mean a yes report. Then , , , and .
  2. 2.The contributions to a yes report are and . Their total is .
  3. 3.The posterior is . The explicit yes-or-no reporting assumption is what makes the second likelihood . A model in which a liar chooses among five false die values would need different likelihoods.

Unequal box sizes and tabulated data

Choosing boxes uniformly does not mean choosing every ball in the collection uniformly. First account for which box was chosen, then for the fraction of the requested colour inside that box. Tables are useful because they keep a box’s favourable count and its own total together.

BoxBlackWhiteRedBlueTotal
I345618
II22228
III12317
IV431513
Example — A black ball from four possible boxes

Problem
Choose one of the four boxes in the table with equal probability and draw uniformly within it. Given a black ball, find the probability that box III was selected.

  1. 1.The prior for every box is . Their black likelihoods are , , , and .
  2. 2.The equal prior factors cancel from the Bayes ratio, giving .
  3. 3.With common denominator , the denominator sum is . Thus the posterior is .
  4. 4.Using one black ball divided by all black balls would model a uniform choice from the pooled collection, which is a different experiment.

Several observations under one hypothesis

Two observations can provide stronger evidence than one. However, their probabilities may be multiplied only when the model makes them independent under the specified hypothesis. Here that means independent production outcomes once the machine setup is fixed.

Example — Was the machine set up correctly?

Problem
A machine setup is correct with probability . An item is acceptable with probability under a correct setup and under an incorrect setup. Assume successive items are independent conditional on the setup. After two acceptable items, find the probability of a correct setup.

  1. 1.Let mean correct setup and mean both selected items are acceptable. The priors are .
  2. 2.The conditional likelihoods are and . The joint contributions are and .
  3. 3.Divide the correct-setup contribution by their total: .
  4. 4.The posterior is greater than the prior because two acceptable items are more likely under a correct setup. We assumed independence given the setup; unconditional independence of the two item outcomes was not required.

Check your understanding

For each situation, identify which numbers describe starting frequencies and which describe outcomes within a case. Interpret the final probability using the group after the word given.

Quiz

Quick check

A condition is rare. Why can false positives outnumber true positives?

Quick check

A source has prior and likelihood for the evidence. What is its joint contribution?

Quick check

Two sources have joint evidence contributions and . Given the evidence, what is the posterior of the first?

Quick check

A hypothesis has positive prior but zero likelihood for the observed evidence. What is its posterior, assuming the evidence has positive total probability?

Quick check

Which assumption justifies multiplying the two acceptable-item likelihoods in the setup example?

Quick check

Four boxes of different sizes are chosen uniformly. Which rule gives the black-ball contribution of box i?

Quick check

All hypotheses have the same positive likelihood for an observation. What happens to the priors?

Practice Problems

Practice Problems
  1. Bag I has four red and four black balls; bag II has two red and six black. Choose a bag uniformly and observe a red draw. Find the probability of bag I.
  2. Sixty percent of college students live in a hostel and forty percent are day scholars. Their probabilities of an A grade are . Given an A grade, find the probability that the student lives in the hostel.
  3. A student knows an answer with probability and otherwise guesses. A guess succeeds with probability , and a known answer is correct. Given a correct answer, find the probability that it was known.
  4. A hypothetical condition affects of a population. A test has true-positive probability and false-positive probability . Given a positive, find the model probability of the condition.
  5. Choose uniformly among a two-headed coin, a coin with head probability , and a fair coin. Given a head, find the probability that the two-headed coin was chosen.
  6. An insurer covers scooter, car, and truck drivers. Accident probabilities are . A uniformly selected insured driver has had an accident. Find the probability that the driver is a scooter driver.
  7. Machines A and B supply of items with defect rates . Given a defective item, find the probability that B made it.
  8. Two groups win control with probabilities . They introduce a product with probabilities conditional on winning. Given that a product was introduced, find the probability that the second group won.
  9. Roll a fair die. On or , toss a fair coin three times; otherwise toss it once. Given exactly one head, find the probability that the die showed or .
  10. Operators A, B, and C work for of production time and have defect rates . Assuming equal production rates, find the probability that A produced a randomly observed defective item.
  11. One uniformly random card is lost from a standard deck. Two cards drawn from the remaining deck are both diamonds. Find the probability that the lost card was a diamond.
  12. A fair coin is tossed. A reporter answers the yes-or-no question “Was it a head?” truthfully with probability , independently of the toss, and otherwise reverses the answer. Given a yes report, find the probability of an actual head.

The red contributions are and . The posterior is .

Key Takeaways

Key Takeaways

• A posterior compares all possible explanations of the observed evidence, with each weighted by its prior. • Base rates and false positives can substantially affect the interpretation of a positive result. • Production shares, not just defect rates, determine the source of a defective item. • Uniformly choosing a container differs from uniformly choosing an object from a pooled collection. • Repeated observations can be combined by multiplication when conditional independence is justified. • Reporting assumptions and sampling assumptions are part of the probability model and must be stated clearly.