Thomas Bayes


Quick Info

Born
1702
London, England
Died
17 April 1761
Tunbridge Wells, Kent, England

Summary
Thomas Bayes was an English clergyman who set out his theory of probability in 1764. His conclusions were accepted by Laplace in 1781, rediscovered by Condorcet, and remained unchallenged until Boole questioned them. Since then Bayes' techniques have been subject to controversy.

Biography

Thomas Bayes' father, Joshua Bayes, was one of the first six Nonconformist ministers to be ordained in England. He was ordained in 1694 and moved to Box Lane Chapel, Bovington, about 25 miles from London. Thomas's mother was Anne Carpenter. The family moved to Southwark, London, when Thomas was young and there Joshua became an assistant at St Thomas's and also an assistant at the Chapel in Leather Lane, Holborn. Thomas was the eldest of his parents seven children, four boys and three girls.

In [1] Hacking claims that Thomas was educated privately, something he says appears necessary for the son of a Nonconformist minister at that time. If this is the case, then nothing is known of his tutors but Barnard in [6] points out the intriguing possibility that he could have been tutored by de Moivre who was certainly giving private tuition in London at the time. However other historians (see for example [21]) suggest that Thomas received a liberal education for the ministry. In that case it is likely that he attended Fund Academy in Tenter Alley which was the only school with the right religious connections near where Bayes lived.

We do know that in 1719 Bayes matriculated at the University of Edinburgh where he studied logic and theology. He had to choose a Scottish university if he was to obtain his education without going overseas since, at this time, Nonconformists were not allowed to matriculate at Oxford or Cambridge. Records which still survive at the University of Edinburgh record that he gave the homily on 14 January 1721 with the text being "Matthew Chapter 7 verses 24-27", and again on 20 January 1722 with the text being "Matthew Chapter 11 verses 29-30". He left the University as a probationer, but he was not ordained at this stage. At some time Bayes must have studied mathematics but there is no evidence that he did so at Edinburgh University. However, he certainly had the opportunity to study mathematics at Edinburgh and when he wrote at age 34:-
I have long ago thought that the first principles and rules of the method of Fluxions stood in need of more full and distinct explanation and proof ...
he certainly suggests that his interest went back to his student days or perhaps shortly afterwards.

Thomas Bayes was ordained, a Nonconformist minister like his father, and at first assisted his father in Holborn. In about 1733 he became minister of the Presbyterian Chapel in Tunbridge Wells, 35 miles southeast of London, on the death of the previous minister John Archer. There is, however, evidence that he was associated with Tunbridge Wells before 1733. One report states (see for example [4] where this is quoted):-
John Archer died in 1733 but was succeeded by Thomas Bayes in 1730, who was a man of considerable attainment. It appears that Thomas Bayes left Tunbridge Wells in 1728 and returned in 1731. During this time he was at Leather Lane Presbyterian Church, London, where his father was pastor.
On 24 August 1746 William Whiston describes having breakfast with Bayes who he says is:-
... a dissenting Minister at Tunbridge Wells, and a Successor, though not immediate, to Mr Humphrey Ditton, and like him a very good mathematician.
Bayes apparently tried to retire from the ministry in 1749 but remained minister at Tunbridge Wells until 1752 when he did retire, but continued to live in Tunbridge Wells.

Bayes set out his theory of probability in Essay towards solving a problem in the doctrine of chances published in the Philosophical Transactions of the Royal Society of London in 1764. The paper was sent to the Royal Society by Richard Price, a friend of Bayes', who wrote:-
I now send you an essay which I have found among the papers of our deceased friend Mr Bayes, and which, in my opinion, has great merit... In an introduction which he has writ to this Essay, he says, that his design at first in thinking on the subject of it was, to find out a method by which we might judge concerning the probability that an event has to happen, in given circumstances, upon supposition that we know nothing concerning it but that, under the same circumstances, it has happened a certain number of times, and failed a certain other number of times.
Dale writes in [4]:-
What may the reader expect to find in this Essay? As regards probability, he will expect, of course, some or other version of what has become known as 'Bayes's theorem': and such expectation will indeed be met. In addition he will find a clear discussion of the binomial distribution and if he should probe even deeper he will find ... the first occurrence of a probability logic result involving conditional probability. The Essay should be of interest to mathematicians for the evaluation of the incomplete beta-function. We note too the use of approximations to various integrals made here and in the Supplement by both Bayes and Price, and the attention paid to the question of the error incurred in the making of such approximation. The Essay, then, mainly, and perhaps justly, remembered for the solution of the problem posed by Bayes, should also be remembered for its contribution to pure mathematics.
Bayes's conclusions were accepted by Laplace in a 1781 memoir, rediscovered by Condorcet (as Laplace mentions), and remained unchallenged until Boole questioned them in the Laws of Thought . Since then Bayes' techniques have been subject to controversy.

Bayes also wrote an article An Introduction to the Doctrine of Fluxions, and a Defence of the Mathematicians Against the Objections of the Author of The Analyst (1736) attacking Berkeley for his attack on the logical foundations of the calculus. In the Preface Bayes gives his reasons for writing the text:-
I have long ago thought that the first principles and rules of the method of Fluxions stood in need of more full and distinct explanation and proof, than what they had received either from their first incomparable author, or any of his followers; and therefore was not at all displeased to find the method itself opposed with so much warmth by the ingenious author of the Analyst; and had it been his only design to bring this point to a fair issue, whether a demonstration by the method of Fluxions be truly scientific or not, I should have heartily applauded his conduct, and have thought he deserved the thanks even of the Mathematicians themselves. But the invidious light in which he has put this debate, by representing it as of consequence to the interests of religion, is, I think, truly unjustifiable, as well as highly imprudent.
Bayes writes that Berkeley:-
...represents the disputes and controversies among mathematicians as disparaging the evidence of their methods: and ... he represents Logics and Metaphysics as proper to open their eyes, and extricate them from their difficulties. ... If the disputes of the professors of any science disparage the science itself, Logics and Metaphysics are much more disparaged than Mathematics, why, therefore, if I am half blind, must I take for my guide one that can't see at all?
Bayes was elected a Fellow of the Royal Society in 1742 despite the fact that at that time he had no published works on mathematics, indeed none were published in his lifetime under his own name, the article on fluxions referred to above was published anonymously. Another mathematical publication on asymptotic series appeared after his death where he showed that the series for logz!\log z! given by Stirling and de Moivre, was not valid since it diverged.

There are a few other pieces of mathematics which have come down to us from Bayes and we now look at some of these. The first we mention is a letter which he wrote, probably around 1756. Bayes wrote:-
You may remember a few days ago we were speaking of Mr Simpson's attempt to show the great advantage of taking the mean between several astronomical observations rather than trusting to a single observation carefully made, in order to diminish the errors arising from the imperfection of instrument and the organs of sense.
In fact Simpson had made the same error that the French would make nearly fifty years later with Borda's repeating circle, in believing that one could make the error in the observation as small as one desired by making multiple observations. However, Bayes realised that this was not so and wrote in his letter:-
Now that the errors arising from the imperfection of the instrument and the organs of sense should be thus reduced to nothing or next to nothing only by multiplying the number of observations seems to me extremely incredible. On the contrary the more observations you make with an imperfect instrument the more it seems to be that the error in your conclusion will be proportional to the imperfection of the instrument made use of ...
In [4] a notebook which was almost certainly written by Bayes is examined in detail. This notebook contains a considerable amount of mathematical work, including discussions of probability, trigonometry, geometry, solution of equations, series, and differential calculus. There are also sections on natural philosophy in which Bayes looks at topics which include electricity, optics and celestial mechanics.


References (show)

  1. I Hacking, Biography in Dictionary of Scientific Biography (New York 1970-1990). See THIS LINK.
  2. Biography in Encyclopaedia Britannica. http://www.britannica.com/biography/Thomas-Bayes
  3. J P Clero, Thomas Bayes. Essai en vue de résoudre un problème de la doctrine des chances (Paris, 1988).
  4. A I Dale, Most honourable rememberance : The life and work of Thomas Bayes (New York- Berlin- Heidelberg, 2003).
  5. L J Savage, The foundations of statistics (New York-London, 1954).
  6. G A Barnard, Thomas Bayes - a biographical note, Biometrika 45 (1958), 293-315.
  7. D R Bellhouse, 2001 : A Bayes odyssey, Chance 12 (3) (1999), 48-50.
  8. D R Bellhouse, On recently discovered manuscripts of Thomas Bayes, Historia Mathematica 29 (2002), 383-394.
  9. A I Dale, Thomas Bayes: A memorial, The Mathematical Intelligencer 11 (3) (1989), 18-19.
  10. A I Dale, Thomas Bayes's work on infinite series, Historia Math. 18 (4) (1991), 312-327.
  11. A I Dale, Thomas Bayes : some clues to his education, Statist. Probab. Lett. 9 (3) (1990), 289-290.
  12. A I Dale, On Bayes' theorem and the inverse Bernoulli theorem, Historia Math. 15 (4) (1988), 348-360.
  13. A I Dale, A newly-discovered result of Thomas Bayes, Arch. Hist. Exact Sci. 35 (2) (1986), 101-113.
  14. A I Dale, Bayes or Laplace? An examination of the origin and early applications of Bayes' theorem, Arch. Hist. Exact Sci. 27 (1) (1982), 23-47.
  15. H Dinges, Gedanken zum Aufsatz des Rev. Th. Bayes (1702-1761), Math. Semesterber. 30 (1) (1983), 61-105.
  16. P Dupont, Un joyau dans l'histoire des sciences : le mémoire de Thomas Bayes de 1763, Rend. Sem. Mat. Univ. Politec. Torino 37 (3) (1979), 105-138.
  17. J Earman, Bayes' Bayesianism, Stud. Hist. Philos. Sci. 21 (3) (1990), 351-370.
  18. D A Gillies, Was Bayes a Bayesian?, Historia Math. 14 (4) (1987), 325-346.
  19. I J Good, Bayes's red billard ball is also a herring, and why Bayes withheld publication, J. Stat. Comput. Simul. 29 (1988), 335-340.
  20. A Hald, Evaluations of the beta probability integral by Bayes and Price, Arch. Hist. Exact Sci. 41 (2) (1990), 139-156.
  21. J D Holland, The Reverend Thomas Bayes, F.R.S. (1702-1761), J. Roy. Statist, Soc. A 125 (1962), 451-461.
  22. J D Holland, The Rev Thomas Bayes, Electronics and Power 11 (1965), 238.
  23. R W Home, Some manuscripts on electrical and other subjects attributed to Thomas Bayes, F.R.S., Notes and Records Roy. Soc. London 29 (1974), 81-90.
  24. F H Murray, A note on a scholium of Bayes, Bull. Amer. Math. Soc. 36 (1930), 129-132.
  25. H L Seal, Thomas Bayes, International Encyclopedia of Statistics (1978), 7-9.
  26. G Shafer, Bayes's two arguments for the rule of conditioning, Ann. Statist. 10 (4) (1982), 1075-1089.
  27. G C Smith, Thomas Bayes and fluxions. Historia Math. 7 (4) (1980), 379-388.
  28. S M Stigler, The History of Statistics. The Measurement of Uncertainty before 1900 (Cambridge, Mass.-London, 1986), 88-.
  29. S M Stigler, Thomas Bayes's Bayesian inference, J. Roy. Statist. Soc. Ser. A 145 (2) (1982), 250-258.
  30. S M Stigler, Who discovered Bayes's theorem?, The American statistician 37 (1984), 290-296.
  31. Thomas Bayes's essay towards solving a problem in the doctrine of chances, in E S Pearson and M G Kendall, Studies in the History of Statistics and Probability (London, 1970), 131-153.

Additional Resources (show)


Honours (show)


Cross-references (show)


Written by J J O'Connor and E F Robertson
Last Update June 2004