Master library
Resources
Every recommended book, course, paper, and doc across the map — ranked, with honest verdicts and a clear “start here.” No dead weight. Hover any card to read the full verdict.
How this list works
Each entry is ranked within its topic — rank 1 is the recommended starting point. Resources that appear in multiple stages are listed once with all their stages tagged; filter by stage to see what belongs where.
Free picks with rank 1 are flagged with a ★ Free pick badge — those are the highest-ROI starting points if you are budget- or time-constrained. “Needs review” entries are in fast-moving areas (particularly Stage 4); treat their details as a snapshot, not a guarantee.
Resources are a single source of truth: every stage page’s resource section pulls from this same list. Nothing is duplicated. The glossary defines every concept these resources teach.
50 resources
Harvard University / David Malan · 2024
The single best foundations course on the internet — rigorous, beloved, and free; no other course teaches this much this well.
Use this if: You are new to programming or want a properly rigorous foundation before anything else.
Reviewed 2026-06-11
Report linkAl Sweigart · 2019
Fastest path to useful Python for non-CS people — you are writing real scripts within hours, not learning abstract theory.
Use this if: You want to get productive in Python immediately and learn by solving real tasks, not toy exercises.
Reviewed 2026-06-11
Report linkPython Software Foundation
The authoritative reference — dry, but covers the language precisely; use it to look things up, not to learn from scratch.
Use this if: You already know basic Python and want to understand a specific feature properly, directly from the source.
Reviewed 2026-06-11
Report linkScott Chacon & Ben Straub
The canonical Git reference — chapters 1–5 are all most practitioners ever need; the rest covers internals for the curious.
Use this if: You want to understand Git properly — not just the commands, but what the commit graph actually is.
Reviewed 2026-06-11
Report linkMIT CSAIL · 2020
Fills the gap every formal program leaves: the shell, Vim, tmux, Git, debugging, profiling — tools you use every day but were never taught.
Use this if: You came from a bootcamp or self-taught path and feel slow in the terminal or lost when something breaks.
Reviewed 2026-06-11
Report linkJosh Starmer
The best statistics intuition anywhere — Starmer explains each concept from first principles, without the hand-waving that makes stats confusing; it is not a shortcut, it is an accelerant.
Use this if: You want to actually understand what hypothesis tests and distributions mean — not just run them — before or alongside a textbook.
Reviewed 2026-06-11
Report linkKhan Academy
Solid foundational drilling — the exercises are genuinely useful, though the content stops well short of inference at the level you need for professional work.
Use this if: You need to build fluency in probability basics and descriptive statistics before moving to inferential tests.
Reviewed 2026-06-11
Report linkDavid Diez, Mine Çetinkaya-Rundel & Christopher Barr · 2019
A genuinely good free statistics textbook — readable, covers inference properly, and has real exercises; the free PDF is the real deal, not a sample.
Use this if: You want a structured textbook for self-study that covers hypothesis testing and regression without costing anything.
Reviewed 2026-06-11
Report linkPractical Statistics for Data Scientists
Peter Bruce, Andrew Bruce & Peter Gedeck · 2020
The best bridge between statistics and data science practice — it treats you as a programmer who needs to think statistically, not a stats student who needs to code.
Use this if: You are comfortable with Python/R and want to understand the statistical underpinnings of what you are already doing, or you are about to start Stage 2 and want the bridge.
Reviewed 2026-06-11
Report linkTableau / Salesforce
The fastest way to build and publish interactive dashboards; the free tier is genuinely capable and the gallery shows you what is possible.
Use this if: You need to develop BI and dashboarding skills — Tableau fluency is an explicit requirement on most analyst job descriptions.
Reviewed 2026-06-11
Report linkJames, Witten, Hastie & Tibshirani · 2023
THE canonical entry point to machine learning — readable, rigorous, and free; the R and Python editions both cover the same concepts, choose by your preference.
Use this if: You are starting machine learning for the first time or want to understand the classical algorithms properly before touching deep learning.
Reviewed 2026-06-11
Report linkHastie, Tibshirani & Friedman · 2009
The rigorous big brother of ISLR — dense, mathematically demanding, and necessary if you want to understand WHY the algorithms work at a deep level.
Use this if: You have finished ISLR and want to go deeper into the mathematical foundations, or you are preparing for research.
Reviewed 2026-06-11
Report linkHands-On Machine Learning with Scikit-Learn, Keras & TensorFlow
Aurélien Géron · 2022
The best practical ML book — clear code, real projects, and it takes you all the way from scikit-learn to neural networks in one coherent progression.
Use this if: You want to build things, not just understand theory — this is the book you work through from cover to cover.
Reviewed 2026-06-11
Report linkDeisenroth, Faisal & Ong · 2020
The single best bridge between undergraduate mathematics and ML — covers linear algebra, calculus, and probability in the context of ML applications.
Use this if: You need to strengthen your mathematical foundations alongside ISLR or before tackling deep learning.
Reviewed 2026-06-11
Report linkAndrew Ng / DeepLearning.AI
The canonical first ML course — Ng explains concepts with unusual clarity, though the assignments are now Python-based and more hands-on than the original.
Use this if: You learn better from video lectures and want a structured, guided path through classical ML with exercises.
Reviewed 2026-06-11
Report linkZhang, Lipton, Li & Smola · 2023
The best hands-on deep learning book — every chapter has runnable code in PyTorch, JAX, and TensorFlow; builds from scratch to transformers.
Use this if: You want to understand deep learning by building it, not just using it — this is the book you code through.
Reviewed 2026-06-11
Report linkGoodfellow, Bengio & Courville · 2016
The theory canon of deep learning — rigorous, dense, and essential for understanding WHY neural networks work; not a first read, but an important eventual reference.
Use this if: You have practical DL experience and want to understand the theoretical underpinnings — backprop, regularization, optimization — at depth.
Reviewed 2026-06-11
Report linkAndrej Karpathy · 2023
You build a transformer from scratch — every gradient, every matrix multiply — and you understand it by the end; this is the closest thing to an essential ML video series.
Use this if: You want deep understanding of neural networks and transformers, not just API fluency — this series is non-negotiable.
Reviewed 2026-06-11
Report linkJeremy Howard / fast.ai
The best top-down practical DL course — starts with working code and walks backward to the theory; covers vision, NLP, and tabular data.
Use this if: You learn better top-down and want to build real models fast, then deepen your understanding of how they work.
Reviewed 2026-06-11
Report linkDesigning Machine Learning Systems
Chip Huyen · 2022
The production MLOps bible — covers every step from data collection to monitoring in production, with clear frameworks and real-world cases; non-negotiable for this stage.
Use this if: You are moving from notebooks to production systems and need to understand what it actually takes to ship and maintain ML at scale.
Reviewed 2026-06-11
Report linkMeta AI / PyTorch Team
The official, authoritative PyTorch reference — the introductory tutorials are the fastest way to get productive; use the advanced sections for specific capabilities.
Use this if: You are learning PyTorch or need to understand a specific capability (custom datasets, ONNX export, distributed training).
Reviewed 2026-06-11
Report linkChloe He, Sergey Karayev, Josh Tobin
Bridges the gap between training a model and shipping a product — covers tooling, infrastructure, and the product decisions around ML.
Use this if: You have trained models but have not shipped one to users, and want a structured path through the full production stack.
Reviewed 2026-06-11
Report linkDocker Inc.
The official Docker introduction — clear, practical, and the right starting point for containerising ML workloads.
Use this if: You are containerising a model or service for the first time and need to understand Docker from first principles.
Reviewed 2026-06-11
Report linkHugging Face
The best practical NLP-to-LLM path — hands-on, current, and covers fine-tuning, PEFT, and deployment in a coherent sequence.
Use this if: You want to move from understanding transformers to using them — fine-tuning, embedding, and serving models with the Hugging Face ecosystem.
Reviewed 2026-06-11
Report linkDeepLearning.AI
Bite-sized and current — the RAG, agents, and evals courses are the fastest way to get hands-on with specific LLM engineering topics.
Use this if: You want to get up to speed on a specific capability (RAG, evals, function calling) quickly and with working code.
Reviewed 2026-06-11
Report linkAndrej Karpathy
A minimal, readable GPT implementation from scratch — the best codebase to read when you want to understand what is actually happening inside an LLM.
Use this if: You want to understand transformer internals at the code level, beyond the Karpathy video series.
Reviewed 2026-06-11
Report linkLilian Weng
Exceptional deep-dives on agents, LLMs, and hallucination — among the best technical writing in ML; dense but worth every word.
Use this if: You want rigorous, well-sourced overviews of a specific LLM topic (agents, RLHF, attention, hallucination) beyond what a course covers.
Reviewed 2026-06-11
Report linkAnthropic
The authoritative reference for the Claude API, prompting best practices, and agent architecture — if you are building with Claude, start here.
Use this if: You are building with Claude or want the canonical prompting and tool-use patterns from Anthropic.
Reviewed 2026-06-11
Report linkExploding Gradients
The standard RAG evaluation framework — covers faithfulness, answer relevancy, and context precision in a way you can actually integrate into a CI pipeline.
Use this if: You are building a RAG system and need to measure quality rigorously, not just vibes-test it.
Reviewed 2026-06-11
Report linkLangChain Inc.
The primary framework for multi-agent orchestration with explicit state — useful for building agents that need complex branching or human-in-the-loop.
Use this if: You are building a multi-agent system and need a framework for managing state, tool calls, and conditional routing.
Reviewed 2026-06-11
Report linkQdrant
Clear, practical docs for one of the best vector databases — the quickstart gets you a working similarity search in minutes.
Use this if: You are building RAG or semantic search and want a production-grade vector database with good Rust-backed performance.
Reviewed 2026-06-11
Report linkVaswani et al. · 2017
The paper that introduced transformers — you need to have read this; the architecture is now everywhere and the original is still the clearest description.
Use this if: You want to understand how transformers work from the original source, before reading any second-hand explanation.
Reviewed 2026-06-11
Report linkDevlin et al. · 2018
The paper that established masked language modelling as the pretraining paradigm — still the canonical read for understanding BERT-family models.
Use this if: You are working with encoder-based models or want to understand the pretraining/fine-tuning paradigm from source.
Reviewed 2026-06-11
Report linkBrown et al. · 2020
The GPT-3 paper that demonstrated in-context learning at scale — important for understanding why LLMs behave the way they do.
Use this if: You want to understand the origins of prompt engineering and in-context learning from the research that defined them.
Reviewed 2026-06-11
Report linkWei et al. · 2022
The paper that formalised chain-of-thought prompting — short, clear, and essential for anyone doing reasoning-heavy LLM work.
Use this if: You are designing prompts for complex reasoning tasks and want the research basis for why step-by-step thinking helps.
Reviewed 2026-06-11
Report linkLewis et al. · 2020
The original RAG paper — explains the retrieval-generation architecture that underpins most production LLM knowledge systems today.
Use this if: You are building a RAG system and want to understand the original architecture and its trade-offs.
Reviewed 2026-06-11
Report linkHu et al. · 2021
The paper that made fine-tuning accessible — introduces the low-rank decomposition trick that is now the standard PEFT method.
Use this if: You are fine-tuning LLMs and want to understand why LoRA works and when it is appropriate.
Reviewed 2026-06-11
Report linkOuyang et al. · 2022
The InstructGPT / RLHF paper — explains how models are aligned with human preferences; essential for understanding why modern LLMs behave so differently from raw language models.
Use this if: You want to understand RLHF and instruction tuning from the original research.
Reviewed 2026-06-11
Report linkChen & Guestrin · 2016
The paper behind the algorithm that still wins tabular Kaggle competitions — surprisingly readable and explains the regularised objective clearly.
Use this if: You use XGBoost and want to understand the algorithm, not just the library — or you are preparing for technical interviews.
Reviewed 2026-06-11
Report linkChristopher Bishop · 2006
The Bayesian-flavoured ML canon — rigorous, comprehensive, and now free from the author; the probabilistic graphical model chapters are the best treatment available.
Use this if: You are moving into research and want the mathematical depth that ISLR does not provide — particularly Bayesian methods.
Reviewed 2026-06-11
Report linkKevin Murphy · 2022
The modern research reference — encyclopaedic, up-to-date through 2022, and freely available; Vol. 1 covers foundations, Vol. 2 covers advanced methods.
Use this if: You are doing research and need a comprehensive, current reference — Bishop is the classic, Murphy is the modern standard.
Reviewed 2026-06-11
Report linkS. Keshav · 2007
Three pages that will save you hundreds of hours — the 3-pass method is the correct way to read research papers and almost nobody teaches it.
Use this if: You are starting to read ML papers and feel like you are drowning — read this first, once, and apply it every time.
Reviewed 2026-06-11
Report linkMeta AI
The best place to find state-of-the-art results with reproducible code — benchmark tables, leaderboards, and linked implementations in one place.
Use this if: You want to find the current SOTA on a benchmark, or you want a paper's official implementation rather than a community reimplementation.
Reviewed 2026-06-11
Report linkDistill team (archive)
An archive of exemplary ML explanation — interactive, visually precise, and a high bar for what clear technical communication looks like; no longer actively publishing, but everything there is worth reading.
Use this if: You want the clearest possible explanation of a specific concept (attention, circuits, feature visualisation) that Distill covered.
Reviewed 2026-06-11
Report linkCornell University
The preprint firehose — every important ML paper appears here before any journal; the skill is learning to filter signal from noise.
Use this if: You are tracking the field and want to stay current — but build the filtering skill first, or you will drown.
Reviewed 2026-06-11
Report link3Blue1Brown / Grant Sanderson
The best geometric intuition for linear algebra — transforms the subject from symbol manipulation to genuine understanding of what vectors and matrices are.
Use this if: You have seen the linear algebra formulas but do not have geometric intuition for what they mean — watch this before or alongside any formal course.
Reviewed 2026-06-11
Report link3Blue1Brown / Grant Sanderson
Builds the intuition for derivatives and integrals that most textbooks never give — the chain rule visualisation alone is worth the series.
Use this if: You want to understand what derivatives actually are before applying them in gradient descent and backpropagation.
Reviewed 2026-06-11
Report linkGilbert Strang / MIT OpenCourseWare
The canonical linear algebra course — Strang's lectures are legendary and the exercises are genuinely instructive; this is the course that makes linear algebra click.
Use this if: You need rigorous linear algebra — eigendecompositions, SVD, projections — for ML applications; 3Blue1Brown gives intuition, Strang gives tools.
Reviewed 2026-06-11
Report linkStephen Boyd & Lieven Vandenberghe · 2004
The optimisation reference — comprehensive, mathematically rigorous, and free; most practitioners need chapters 1–5; researchers need the rest.
Use this if: You want to understand why gradient descent works, when it does not, and what the theory of convex optimisation actually says.
Reviewed 2026-06-11
Report linkJoseph Blitzstein & Jessica Hwang
The best probability course and textbook combination — Blitzstein's lectures are the clearest treatment of conditioning, distributions, and Bayes available for free.
Use this if: You need to build a solid probability foundation for machine learning — or you are headed toward research and need probability to be second nature.
Reviewed 2026-06-11
Report link