Andrej Karpathy's essay "Software 2.0": neural networks as a new way to write software
On Nov 11, 2017 Andrej Karpathy, then Tesla's director of AI, published "Software 2.0" on Medium. It argues that neural networks are not just another classifier but a new software stack: humans specify goals and curate datasets, and optimization writes the program (the weights). The framing shaped how the industry talks about ML engineering and led to his later 'Software 3.0' (prompting LLMs) and 'vibe coding' ideas.
Key facts
- Published on Medium Nov 11, 2017; announced on X the same day ('New blog post: "Software 2.0"')
- Software 1.0 = explicit code written by humans; Software 2.0 = neural-network weights found by optimization against a dataset and goal
- Argues much of the software stack (vision, speech, translation, games) was already moving to 2.0, with data curation becoming the main programming activity
What happened
Karpathy's essay described neural networks as a new programming paradigm, in which the programmer's job becomes collecting, labeling and cleaning data and choosing an architecture and objective, while gradient descent searches program space.
Why it matters
It gave the deep-learning era its best-known software-engineering metaphor, and Karpathy's later talks ('Software 3.0', where natural-language prompts program LLMs) and his 2025 'vibe coding' post build directly on it.
Changelog
- 2026-09-29: created (important-essays backfill; primary source checked)
Related posts (1)
- Andrej Karpathy Andrej Karpathy @karpathy · x · 2017-11-11
Cited as a source by: 2017-11-11-karpathy-software-2-0
Related events
- Andrej Karpathy coins "vibe coding" ★★★
- Rich Sutton publishes "The Bitter Lesson": general methods that scale with compute win ★★★★
Sources (2)
id: 2017-11-11-karpathy-software-2-0 · updated 2026-09-29 · open in the interactive timeline