Abstract

I actually own a copy of Harold Jeffreys’s Theory of Probability but have only read small bits of it, most recently over a decade ago to confirm that, indeed, Jeffreys was not too proud to use a classical chi-squared p-value when he wanted to check the misfit of a model to data (Gelman, Meng and Stern, 2006). I do, however, feel that it is important to understand where our probability models come from, and I welcome the opportunity to use the present article by Robert, Chopin and Rousseau as a platform for further discussion of foundational issues. 2 In this brief discussion I will argue the following: (1) in thinking about prior distributions, we should go beyond Jeffreys’s principles and move toward weakly informative priors; (2) it is natural for those of us who work in social and computational sciences to favor complex models, contra Jeffreys’s preference for simplicity; and (3) a key generalization of Jeffreys’s ideas is to explicitly include model checking in the process of data analysis.

Keywords

Variable-order Bayesian networkApproximate Bayesian computationComputer scienceMarkov chain Monte CarloBayesian inferenceBayesian probabilityInferenceDirichlet processFrequentist inferenceBayesian statisticsMathematicsAlgorithmArtificial intelligence

Affiliated Institutions

Related Publications

Bayes Factors

Abstract In a 1935 paper and in his book Theory of Probability, Jeffreys developed a methodology for quantifying the evidence in favor of a scientific theory. The centerpiece wa...

1995 Journal of the American Statistical A... 11631 citations

Theory of Probability

Abstract Jeffreys' Theory of Probability, first published in 1939, was the first attempt to develop a fundamental theory of scientific inference based on Bayesian statistics. Hi...

1998 Nature 6694 citations

Modelling Binary Data

INTRODUCTION Some Examples The Scope of this Book Use of Statistical Software STATISTICAL INFERENCE FOR BINARY DATA The Binomial Distribution Inference about the Success Probabi...

2002 1450 citations

Publication Info

Year
2003
Type
book
Citations
13687
Access
Closed

External Links

Social Impact

Altmetric
PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

13687
OpenAlex
2663
CrossRef

Cite This

Andrew Gelman, John B. Carlin, Hal S. Stern et al. (2003). Bayesian Data Analysis. . https://doi.org/10.1201/9780429258480

Identifiers

DOI
10.1201/9780429258480

Data Quality

Data completeness: 70%