Bayesian reasoning

Don’t let the title put you off. This article is about updating your thinking. You may have thought one way about something, such as the probability that you come down with some disease, let’s say, A. Then you get new information in the form of a test for the disease which you take. If the test says you have the disease, does that mean you do? Well, maybe…

First, there is a psychological factor. Maybe you know that, statistically, 20% of people have A at one time or another in their lives. But that’s just a number and you know perfectly well that you don’t have A. So that’s the first result of the test: Because it claims you do have A, you suddenly are catapulted into that part of the statistic, that 20% who “have” A, or so it seems. You have been tested and found wanting.

Mathematical reasoning

Problem is, such tests are not perfect. They make two kinds of errors: missed positives and false positives. Suppose for this test that it discovers only 80% of the people who have the disease, leaving 20% running around in (happy?) ignorance of their plight. Those 20% are the missed positives. That doesn’t encourage you any. More serious is the number of identification errors the test makes, the false positives. saying that a healthy person has A when she does not. Aha, there is an out, you say. Well, perhaps…

Let’s look at it in a bit more detail. We know the following:

  • Only 20% of humanity have A. This is the initial datum you started with..
  • Of that 20% who have A, the test finds only 80%, it misses the other 20% completely, the missed positives.
  • There are false positives, due to the test’s finding healthy people to be sick. Suppose that is 10%, meaning 10% of the non-sick people.

Let’s run through that one more time, taking a slightly closer look.

  • That 20% of humanity have A was all that you knew before you were tested. It is therefore your initial datum, a probability, your opinion before the test. Statisticians call this credence, or degree of confidence.
  • The 80% that the test finds. These people all have A and are therefore part of the 20% of the initial datum. This is new information which you must take into account, i.e., learn to live with.
  • But 80% of all people do not have A. Nevertheless, the test will find that 10% of them have A anyway, even though that is just plain wrong.

This is easiest to understand if we suppose some real numbers. So, one more round.

  • Out of 1,000 people chosen at random, 20% of them have A, i.e., 200 people.
  • The test will find only 80% of those, meaning 80% of 200, which is 160 people.
  • But of the 800 people who do not have A, the test will claim that 10% of them have A anyway, which is 80 people.

So we have initially 200 people who have A, of whom the test identifies 160. But it also claims that 80 healthy people have A. You want to be in that last group, the healthy ones who test positive. It is easy to calculate the probability of your actually having A. It is just

probability that you have A because the test says you do

= (the number of people the test finds who actually do have A)

divided by

(the total number of people the test says have A, whether they do or not).

If this is not clear, you have the choice of

  • re-reading the last formula,
  • going back and reading this all again, or
  • giving up, or
  • complaining to me that I cannot explain it well enough.1By now, you have figured out that I love lists.

Using P to indicate the probability, the above formula is just

P = \frac{160}{160 + 80} = \frac{160}{240} = \frac{2}{3} = 67\%

Those figures are all large whole numbers because we supposed a sample of 1000 people and multiplied all the probabilities by that number. But since those numbers occur both in the numerator and denominator of our formula, we could divide them out on the top and the bottom and just use the probabilities.

Let’s make sure we understand this.

Initially, you thought the probability of your having A was 20%. Call that probability P(A).

Now, the test has provided you new information which you must use to update your thinking on the matter. But it would be foolish to trust the test completely or forget about that initial estimate.

So let’s take into account both the initial probability P(A) and the test, which we will refer to as B. The new probability you have A is the quotient of the probability that the test has identified you correctly and the probability that it has identified you at all – correctly or incorrectly – call it P(A|B), the funny thingy in parentheses meaning the A probability updated by test B. (Sorry for the notation. If you know better, please let me know.) So the new, updated probability is

P(A|B) = \frac{P(B|A)*P(A)}{P(B)}                 (1)

where

  • P(A) = the initial probability anyone has A (20%);
  • P(B|A) is the probability that someone who has A will be found by the test B (the 80%);
  • P(B) is the total probability that anyone, sick or not, will be found by the test (80% of 20% added to 10% of 80%);
  • P(A|B) means the probability the test is correct given a positive result of B – and that you have A.

The test is really any new information on the subject. So what this means is that

  • P(A) = prior positive confidence (or credence)
  • P(-A) = prior negative confidence
  • P(B|A) = positive confidence of new information
  • P(B|-A) = negative confidence level of new information

(If you got that, skip this parenthetical rehash. If you need more convincing, remember that in our example the 160 is really

  • .80 (or 80%), the probability of the test’s identifying a true positive, P(B|A);
  • multiplied by .20, the probability of being a true positive before the test. (which you can take to be the “real” proportion of people with A by the initial data), P(A);
  • multiplied by 1000, the number of people,

The additional term 80 in the denominator is

  • .10 (or 10%), the probability that the test mistakenly identifies a false positive, which we could logically call P(B|-A);
  • multiplied by .80 (80%), the probability that anyone does not have A, i.e., 1-P(A).
  • multiplied by 1000, the number of people,

End of parenthesis.)

We can make the denominator more explicit by realizing that it is the sum of two terms in this case. Then equation (1) becomes

P(A|B) = \frac{P(B|A)*P(A)}{P(B|A)P(A) + P(B|-A)P(-A)}    (2)

where P(B|-A) is the probability that the test is positive even though one does not have A (10%).

In equation (2), notice what happens if the test is really bad, so that the probability P(B|-A) of false positives is great. The denominator will become very large, so the probability of having A, P(A|B), becomes quite small, as we would expect. Also, if the initial probability of having A, P(A), is very large, then P(B|-A) is small and P(A|B) approaches P(A), again as we expect.

Back to simple

Whatever be the denominator,

P(A|B) is proportional to the product of P(B|A) and P(A).

The greater the initial probability, the more likely you are to have it; and the greater the accuracy of the test, the same.

It’s all about updating your opinion when new data comes in.

Let’s take a silly example. Suppose P(A), the initial opinion, is quite strong, as in the case of a true believer in supernatural phenomena (aka god or gods). Then you reason with him, pointing out that there is no reason whatsoever for accepting such hypotheses. But P(-A) is negligible in his case, so P(A|B) is always about P(A), which is around 100%. You will never convince the guy of anything.

On the other hand, my initial probability for the truth of such myths is P(A) = 0, but let’s be generous and suppose it is 1%, or 0.01. But then P(-A) is huge, around .99, so the denominator blows up and P(A|B) is still around 0. It also helps (or not, according to your point of view) that in this case, the probability of the new information’s being true is also negligible.

A more realistic example, which is often seen, is the case of breast cancer. Here are the probabilities in tabular form.

  Cancer (1%) No cancer (99%)
Test positive 80% 9.6%
Test negative 20% 90.4%

Most of these probabilities are similar to what we assumed in the first part: 80% of true positives, 20% of false; as well as 9.6% of false positives. But the initial probability is only 1%, not 10%. So we expect a much lower number. What we find is

P(A|B) = \frac{0.8*0.01}{0.8*0.01 + 0.096*0.99} = \frac{.008}{.008+.09504} = 0.0776

i.e., about 7.8%, a rather small probability for having breast cancer. This is understandable, since the test makes rather many mistakes, about 10%, but mainly because the number of women who do not have breast cancer is quite large, about 99%. WARNING: These figures may not be correct, so don’t refuse treatment because of this document: Consult your doctor first.

A last example. In complete ignorance of the facts, let’s suppose that 50% of people over 65 eventually contract AD, Alzheimer’s disease. And let’s suppose that medical ignorance of the subject is such that the only tests are about 50% good, finding half the people who will get it and predicting as many false positives. Then our equation is

P = \frac{.5*.5}{.5*.5 + .5*.5} = 0.5

or 50%, showing, as we assumed, that we know nothing about it.2I repeat, this is a silly hypothesis and is not true – I hope.

Notes

Notes
1 By now, you have figured out that I love lists.
2 I repeat, this is a silly hypothesis and is not true – I hope.

Bibliography and sources

Basic modern physics (including quantum theory and relativity)

Atkins, Peter, The laws of thermodynamics: A very short introduction. Oxford: Oxford University Press, 2010. Kindle edition.

Feynman, Richard P. Six Easy Pieces: Essentials of physics explained by its most brilliant teacher. Cambridge, MA: Perseus Books, 1995. Print.

Feynman, Richard Phillips. Six Not-so-easy Pieces: Einstein’s Relativity, Symmetry, and Space-time. London: Penguin, 1999. Print.

Kumar, Manjjit. Quantum: Einstein, Bohr and the great debate about the nature of reality. London: Icon Books Ltd, 2009. Print.

Seife, Charles. Decoding the universe: How the new science of information is explaining everything in the cosmos, from our brains to black holes. New York: Penguin, 2006. Print.

Shankar, R. Fundamentals of Physics. Mechanics, Relativity, and Thermodynamics. New Haven: Yale UP, 2014. Print.

Susskind, Leonard and Friedman, Art. Quantum mechanics, the theoretical minimum. New York: Basic Books, 2014. Print.

Susskind, Leonard and Hrabovsky, George. The theoretical minimum: What you need to know to start doing physics. New York: Basic Books, 2013. Print.

Von Baeyer, Hans Christian. Warmth disperses and time passes: The history of heat. New York: Modern Library Paperbacks, 1999. Print.

Cosmology

Carroll, Sean. From eternity to here: The quest for the ultimate theory of time. New York: Plume, 2010. Print.

Carroll, Sean M. The Particle at the End of the Universe: How the Hunt for the Higgs Boson Leads Us to the Edge of a New World. London: Oneworld, 2012. Print.

Chandra X-ray Observatory, web site, http://chandra.harvard.edu/index.html.

Coles, Peter. Cosmology: A Very Short Introduction. Oxford: Oxford UP, 2001. Print.

Goldberg, Dave and Blomquist, Jeff. A users’s guide to the universe: Surviving the perils of black holes, time paradoxes, and quantum uncertainty. Hoboken: John Wiley & Sons, Inc., 2010. Print.

Greene, Brian. The fabric of the cosmos: Space, time, and the texture of reality. New York:Vintage Books, 2005. Print.

Greene, B. The Hidden Reality: Parallel Universes and the Deep Laws of the Cosmos. New York: Vintage, 2011. Print.

Guth, Alan. The inflationary universe: The quest for a new theory of cosmic origins. New York: Basic Books, 1997. Print.

Kirshner, Robert P. The extravagant universe: Exploding stars, dark energy, and the accelerating cosmos. Princeton: Princeton University Press, 2002. Print.

Larson, Richard B. and Bromm, Volker. The first stars in the universe. Scientific American, 2004 (update from December 2001 issue).

Rothery, David A. Planets: A very short introduction. Oxford: Oxford University Press, 2010. Print.

Tegmark, Max. Our Mathematical Universe: My Quest for the Ultimate Nature of Reality. London: Penguin, 2014. Print.

Wilkinson Microwave Anisotropy Probe, “Universe 101: Big Bang Theory”. National Aeronautics and Space Administration. Online at http://map.gsfc.nasa.gov/cosmology/cosmology.html.

Geology

There are geology books, e.g,, those by Spooner or McDougall, which are excellent introductions to physical and historical geology. Benton’s book is more recent than McDougall’s, but it is shorter and so denser and less easy to follow, although filled with interesting information. Then there are the books of Richard Fortey. Fortey’s books are not textbooks and, in this writer’s opinion, not good for learning the subject. But they are simply wonderful field trips. Yes, trips. Fortey has a way of describing a tour of, say, the 250-Mya supercontinent Pangea or of the Cretaceous Era as if you were actually wandering around it with Fortey as guide and companion. He does the same for current environments, like the area around Vesuvius. It is very human, a combination of field trip and tour guide and not to be missed.

The USGS web site is a mine of information for amateur geologists. The article “This dynamic earth” is an excellent explanation of plate tectonics, explained clearly with very good illustrations.

For a general history of earth and life on it, McDougall’s book Is excellent, including geology, climate and the origins of life and its subsequent evolution. But Emiliani’s book is extraordinary. Ostensibly an earth-science book, it starts with atomic physics, cosmology, chemistry and works its way through geology and paleontology. He is not afraid of using some mathematics and the result is almost like reading a novel. An excellent book. Too bad Emiliani died shortly after the book’s publication in 1992, but it is still mostly quite useful.

Benton, Michael J. The history of life: A very short introduction. Oxford: Oxford University Press, 2008. Print.

Bonewitz, Ronald Louis. Rocks and Minerals: The definitive visual guide. London: DK, 2012. Print.

De Palma, Christopher. Astro 801, on-line course from Pennsylvania State University. https://www.e-education.psu.edu/astro801/

Emiliani, Cesare. Planet Earth: Cosmology, Geology, and the Evolution of Life and Environment. Cambridge: Cambridge UP, 1992. Print.

Fortey, Richard A. Earth: An Intimate History. New York: Vintage, 2005. Print.

Fortey, Richard. Fossils: The key to the past. London: Natural History Museum. 1982. Print.

Fortey, Richard. Life: An unauthorised Biography. London: Flamingo. 1998. Print.

Kious, W, Jacquelyne and Tilling, Robert I. This dynamic earth: The story of plate tectonics. Washington: USGS, 2012. Online at http://pubs.usgs.gov/gip/dynamic/dynamic.html.

McDougall, J. D. A short history of planet earth: Mountain, mammals, fire, and ice. New York: John Wiley and Sons, Inc., 1998. Print.

Marshak, Stephen. Earth: Portrait of a Planet, 4th Ed. New York: Norton, 2012. Print.
Redfern, Martin. The earth: A very short introduction. Oxford: Oxford University Press, 2003. Print.

Spooner, Alecia M. Geology for dummies. Hoboken: John Wiley & Sons, Inc., 2011. Print.

[Various authors]. U. S. Geological Survey. www.usgs.gov

Genetics, evolution, paleontology

Coyne, Jerry A. Why Evolution Is True. Oxford: Oxford UP, 2009. Print.

Dawkins, Richard. A devil’s chaplain: Selected writings. London: Orion Books, 2003. Print.

Dawkins, Richard. The greatest show on earth: The evidence for evolution. New York: Free Press, 2009. Print.

Dawkins, Richard. The magic of reality: How we know what’s really true. London: Transworld Publishers, 2011.

Dawkins, Richard. The selfish gene (30th anniversary edition). Oxford: Oxford University Press, 2006. Print.

Dawkins, Richard. Unweaving the rainbow: Science, delusion and the appetite for wonder. London: Penguiin, 1999. Print.

Hublin, Jean-Jacques, and Bernard Seytre. Quand d’autres hommes peuplaient la terre: Nouveaux regards sur nos origines. Paris: Flammarion, 2011. Print.

Knoll, Andrew H. Life on a Young Planet: The first three billion years of evolution on earth. Princeton, NJ: Princeton UP, 2003. Print.

Leakey, Richard E.. The origin of humankind. New York: Basic Books, 1994. Print.

Meredith, Martin. Born in Africa: The quest for the origins of human life. London: Simon & Schuster, 2011. Print.

Monod, Jacques. Le hasard et la nécessitë. Paris: Le Seuil, 1970. Print. (Available in English translation as Chance and necessity)

Picq, Pascal. Au commencement était l’homme. Paris: Odile Jacob, 2013. Print.

Picq, Pascal. Les origines de l’homme: L’odysée de l’espèce. Paris: Editons Tallandier, 2005 Print.

Picq, Pascal and Roche, Hélène. Les premiers outils. Paris: Le pommier, 2013. Print.

Picq, Pascal, Sagar, Laurent, Dehaene, Ghislaine and Lestienne, Cécile. La plus belle histoire du langage. Paris:Editions du Seuil, 2008.Print.

[Various authors]. Hominidés, les évolutions de l’homme. Online at www.hominides.com. (In French)

[Various authors]. Smithsonian Human Origins Program. Online at humanorgins.si.edu.
Wells, Spencer. The Journey of Man: A Genetic Odyssey. New York: Random House Trade Paperbacks, 2002. Print.

Wilson, David Sloan. Darwin’s cathedral. Chicago: The University of Chicago Press, 2003. Print.

Wilson, David Sloan. Evolution for everyone: How Darwin’s theory can change the way we think about our lives. New York: Bantam Dell, 2007. Print.

Wood, Bernard A. Human Evolution: A Very Short Introduction. Oxford: Oxford UP, 2005. Print.

Anatomy, physiology and neurosciences

Aamodt, Sandra, and Sam Wang. Welcome to Your Brain: Why You Lose Your Car Keys but Never Forget How to Drive and Other Puzzles of Everyday Life. New York: Bloomsbury, 2008. Print.

Amthor, Frank. Neuroscience for Dummies. Mississauga, Ont.: Wiley, 2012. Print.

Bear, Mark F., Barry W. Connors, and Michael A. Paradiso. Neuroscience: Exploring the Brain. Philadelphia, PA: Lippincott Williams & Wilkins, 2007. Print.

Damasio, Antonio. Descartes’ error: Emotion, reason and the human brain. New York: Penguin, 1994. Print.

Edelman, Gerald M. Second nature: Brain science and human knowledge. New Haven: Yale UP, 2006. Print.

Edelman, Gerald M. Wider than the sky: A revolutionary view of consciousness. London: Penguin, 2004. Print.

Frith, Chris. Making up the mind: How the brain creates our mental world. Malden, MA: Blackwell Publishing, 2007. Print.

Gibb, Barry J. The rough guide to the brain. London: Rough Guides, 2007. Print.

Kratz, René Fester. Molecular & Cell Biology for Dummies. Hoboken, NJ: Wiley, 2009. Print.

Levitin, Daniel J. This is your brain on music: The science of a human obsession. New York: Penguin Group, 2006. Print.

Norris, Maggie, and Donna Rae Siegfried. Anatomy & Physiology for Dummies. Hoboken, NJ: Wiley, 2011. Print.

Pinker, Steven. How the Mind Works. New York: Norton, 1997. Print.

Pinker, Steven. The language instinct: How the mind creates language. New York: Harper Collins, 1994. Print.

Ramachandran, Vilayanur and Blakeslee, Sandra. Phantoms in the brain. London: Harper, 2005. Print.

Ramachandran, Vilayanur. The emerging mind: The Reith Lectures 2003. London: Profile Books, 2003. Print.

Ramachandran, Vilayanur. The tell-tale brain. London: Windmill Books, 2012. Print.

Rose, Steven. The 21st-century brain: Explaining, mending and manipulating the mind. London: Vintage, 2005. Print.

Sacks, Oliver. Hallucinations. New York: Borzoi, 2012. Print.

Sacks, Oliver. Musicophilia: Tales of music and the brain. New York: Vintage, 2008. Print.

Sacks, Oliver. The man who mistook his wife for a hat. New York: Touchstone, 1970. Print.

Ecology

Kolbert, Elizabeth. Field notes from a catastrophe: A frontline report on climate change. London: Bloomsbury Publishing PLC, 2007. Print.

More

Bryson, Bill. A short history of nearly everything. London: Transworld Publishers, 2003. Print.

Lightman, Alan P. Mr G: A Novel about the Creation. New York: Pantheon, 2012. Kindle Edition. Fascinating short novel about a godling who lives in a multiverse and like to make and observe universes.