journal article
Oct 01, 2016
Solomonoff Prediction and Occam’s Razor
Abstract
Algorithmic information theory gives an idealized notion of compressibility that is often presented as an objective measure of simplicity. It is suggested at times that Solomonoff prediction, or algorithmic information theory in a predictive setting, can deliver an argument to justify Occam’s razor. This article explicates the relevant argument and, by converting it into a Bayesian framework, reveals why it has no such justificatory force. The supposed simplicity concept is better perceived as a specific inductive assumption, the assumption of effectiveness. It is this assumption that is the characterizing element of Solomonoff prediction and wherein its philosophical interest lies.
Topics
No keywords indexed for this article. Browse by subject →
References
49
[3]
Zabell (2011)
[4]
Suppes (2002)
[6]
Wood (2013)
[7]
Stalker (1994)
[8]
Lemmer (2009)
[9]
Barron (1998)
[11]
Kelly (2008)
[13]
[14]
Reichenbach (1935)
[15]
Wallace (2005)
[16]
A formal theory of inductive inference. Part I
R.J. Solomonoff
Information and Control
10.1016/s0019-9958(64)90223-2
[17]
Dawid "Present Position and Potential Developments: Some Personal Views" Journal of the Royal Statistical Society (1984)
[18]
Bayes Factors
Robert E. Kass, Adrian E. Raftery
Journal of the American Statistical Association
10.1080/01621459.1995.10476572
[19]
Kelly (1996) 10.1093/oso/9780195091953.001.0001
[21]
de Finetti "La prévision: Ses lois logiques, ses sources subjectives" Annales de l’Institut Henri Poincaré (1937)
[22]
Romeijn "Hypotheses and Inductive Predictions" Synthese (2004)
[25]
Carnap (1950)
[27]
[28]
Rissanen (1989)
[30]
[31]
Kolmogorov "Three Approaches to the Quantitative Definition of Information" Problems of Information Transmission (1965)
[32]
Goodman (1955)
[33]
Ortner (2011)
[34]
Lemmer "The Discovery of Algorithmic Probability" Journal of Computer and System Sciences (1997) 10.1006/jcss.1997.1500
[35]
Braithwaite (1957)
[37]
[39]
[40]
Solomonoff (1986)
[42]
[44]
Hintikka (1971)
[47]
Carnap (1952)
[48]
Solomonoff, Raymond J. 1960. “A Preliminary Report on a General Theory of Inductive Inference.” Technical report, Zator, Cambridge, MA.
[49]
Vitányi (2005)
Metrics
13
Citations
49
References
Details
- Published
- Oct 01, 2016
- Vol/Issue
- 83(4)
- Pages
- 459-479
- License
- View
Authors
Cite This Article
Tom F. Sterkenburg (2016). Solomonoff Prediction and Occam’s Razor. Philosophy of Science, 83(4), 459-479. https://doi.org/10.1086/687257
Related