Essay2019
The Bitter Lesson
Richard Sutton
General methods that leverage computation consistently beat hand-engineered human knowledge, and researchers keep relearning this.
≈1,100 wordslink checked 17 Sept 2026Artificial Intelligence · Machine Learning Foundations
Foundations & Overviews
A topic within Machine Learning Foundations, itself one of 15 topics in that field and part of Artificial Intelligence.
Reading on Foundations & Overviews
4A way in
Start here
No prior grounding assumed.
The Bitter Lesson
Richard Sutton · 2019
General methods that leverage computation consistently beat hand-engineered human knowledge, and researchers keep relearning this.
+2 more at this level
Go deeper
Primary sources and full treatments.
Stanford CS229: Machine Learning
Anand Avati (Stanford Online) · 2019
The full derivations behind the standard machine learning methods, treating generalisation and bias-variance as the subject rather than a preliminary…
4 works
Essay2009
The Unreasonable Effectiveness of Data
Halevy, Norvig & Pereira
For messy human problems such as language, a simple model over far more data beats an elegant model over less, so effort is better spent on the corpus.
link checked 17 Sept 2026Paper2012
A Few Useful Things to Know about Machine Learning
Pedro Domingos
Twelve lessons practitioners otherwise learn the hard way: generalisation is the only goal, more data beats a cleverer algorithm, and intuition fails in high dimensions.
link checked 17 Sept 2026Series2019
Stanford CS229: Machine Learning
Anand Avati (Stanford Online)
The full derivations behind the standard machine learning methods, treating generalisation and bias-variance as the subject rather than a preliminary to model fitting.
link checked 17 Sept 2026