Rich Sutton publishes "The Bitter Lesson": general methods that scale with compute win
On March 13, 2019 reinforcement-learning pioneer Rich Sutton published the short essay "The Bitter Lesson". It argues that the biggest lesson of 70 years of AI research is that general methods leveraging computation (search and learning) ultimately beat approaches that build in human knowledge, 'and by a large margin'. It became the canonical statement of the scaling philosophy behind modern frontier AI.
Key facts
- Published March 13, 2019 on incompleteideas.net
- Core claim: 'general methods that leverage computation are ultimately the most effective, and by a large margin', driven by the falling cost of computation (a generalization of Moore's law)
- Examples: computer chess and Go (search), speech recognition, computer vision
- Conclusion: build in 'only the meta-methods that can find and capture this arbitrary complexity', not our own discoveries
What happened
In about 1,100 words Sutton argued that researchers keep trying to build human knowledge into AI systems, which helps in the short term, but that approaches which scale with computation, such as search and learning, eventually win every time, which is 'bitter' for the researchers involved.
Why it matters
The essay is widely cited as the philosophical basis of the scaling era, from GPT-3 and the scaling-laws papers to today's compute-heavy frontier training and the RSI debates of 2026, in which lab leaders such as Jakub Pachocki describe progress as driven mainly by compute.
Changelog
- 2026-09-29: created (important-essays backfill; primary source checked)
Related events
- OpenAI publishes 'Scaling Laws for Neural Language Models' ★★★★★
- Andrej Karpathy's essay "Software 2.0": neural networks as a new way to write software ★★★
Sources (1)
id: 2019-03-13-sutton-bitter-lesson · updated 2026-09-29 · open in the interactive timeline