Books › AI Engineer roadmap

Best books for AI Engineers

An applied LLM list. It begins with how language models work, how to prompt them and the machine-learning basics underneath. The build set covers engineering foundation-model applications, a production handbook, building a model from scratch, search and transformers in practice. The lead set covers system design, data systems, reusable patterns and technical leadership.

12 books in 3 stages, about 4,310 pages (at least 108 hours of reading). The notes are ours, with no ratings or sales claims.

See the full AI Engineer roadmap →

How to choose your books

A short method, so you read the right book for where you are instead of the longest list.

Find your stage

  • Getting started · 3 books

    How LLMs work and how to steer them: model internals at a working level, prompting and machine-learning basics.

    Jump to this stage ↓
  • Doing the job · 5 books

    Building real applications: the engineering of foundation-model apps, production practice, building a model from first principles, retrieval and transformers.

    Jump to this stage ↓
  • Senior and leading · 4 books

    Systems and leadership: designing ML systems, data infrastructure, patterns for reuse and senior technical influence.

    Jump to this stage ↓

If you are unsure, start one stage lower than you think. Books in a later stage assume the working knowledge the earlier ones give you.

Begin with one book

Our starting pick

Hands-On Large Language Models

by Jay Alammar, Maarten Grootendorst · 2024

It is heavily visual and gives a working picture of how language models operate before you build anything on top of them.

See the book ↓

Then pick by your situation

Choose the next book by the problem in front of you, not by its place in the list.

Check it against what AI Engineer postings ask for

These skills come from our analysis of live AI Engineer job postings. If one is new to you, its book list sits one click away.

Each step on the scale reflects how often live job postings name the skill, tool or credential, based on our analysis of those postings.

Set a time budget

StageBooksPagesReadingAt 3 hrs a week
Getting started31,51038 hrs13 wks
Doing the job5≥ 870≥ 22 hrs≥ 7 wks
Senior and leading41,93048 hrs16 wks
All 3 stages12≥ 4,310≥ 108 hrs≥ 36 wks

Treat this as a ceiling, not a target. Read one book at a time, apply it, then move on; read reference-style books in sections. Totals are approximate.

Judge any book before you buy it

  • Age

    This list runs from 2017 (Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow) to 2025 (AI Engineering). Older books earn their place by teaching principles that do not change. For tools and platforms, buy the latest edition.

  • Level

    Check the stage before the title. A book from a later stage will make sense only once you have faced the problems it solves.

  • Format

    The longest book here, Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow, runs about 860 pages. Read very long books as references: pick the chapter that matches the problem you have.

  • Fit

    Ask what you will do differently the week after you finish. If you cannot answer, the book is for a different moment. Come back to it when the situation arrives.

Getting started

How LLMs work and how to steer them: model internals at a working level, prompting and machine-learning basics.

  • Cover of Hands-On Large Language Models
    Start here

    Hands-On Large Language Models

    by Jay Alammar, Maarten Grootendorst · 2024

    ~400 pages~10 hrs to read

    A visual, code-first tour of tokens, embeddings, text generation, semantic search, RAG and fine-tuning. Read it first if you can program but have not yet built on language models.

    View book →
  • Cover of Prompt Engineering for LLMs

    Prompt Engineering for LLMs

    by John Berryman, Albert Ziegler · 2024

    ~250 pages~6 hrs to read

    Covers how models read a prompt and how to assemble context, structure instructions and build prompts into applications. Good early on, when most of your output is prompts and the glue around them.

    View book →
  • Cover of Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow

    Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow

    by Aurélien Géron · 2017

    ~860 pages~22 hrs to read

    A broad, code-heavy grounding in classical machine learning and neural networks. Work through it to understand what sits underneath the model APIs you will be calling.

    View book →

Doing the job

Building real applications: the engineering of foundation-model apps, production practice, building a model from first principles, retrieval and transformers.

  • Cover of AI Engineering

    AI Engineering

    by Chip Huyen · 2025

    ~350 pages~9 hrs to read

    Covers building applications on foundation models: evaluation, prompting, RAG, finetuning, inference optimisation and the architecture around them. The closest thing to a textbook for the role; read it once you have shipped a first feature.

    View book →
  • LLM Engineer's Handbook

    by Paul Iusztin, Maxime Labonne · 2024

    Walks an LLM application through data collection, fine-tuning, deployment, RAG and monitoring as one end-to-end system. Useful when you are moving from a demo to something that has to run and be maintained.

    View book →
  • Cover of Build a Large Language Model (From Scratch)

    Build a Large Language Model (From Scratch)

    by Sebastian Raschka · 2024

    Builds a GPT-style model step by step in PyTorch, from tokenisation and attention to pretraining and finetuning. Read it when you want to know why the models behave as they do, not just how to call them.

    View book →
  • AI-Powered Search

    by Trey Grainger, Doug Turnbull, Max Irwin · 2024

    ~520 pages~13 hrs to read

    Explains how to combine search relevance, embeddings, learning to rank and LLMs into retrieval systems. The best fit if your work leans on RAG and you want retrieval that holds up, not just a vector lookup.

    View book →
  • Cover of Natural Language Processing with Transformers

    Natural Language Processing with Transformers

    by Lewis Tunstall, Leandro von Werra, Thomas Wolf · 2022

    A practical guide to the Hugging Face ecosystem: classification, named entity recognition, summarisation, question answering and training your own transformer. Read it when you need to go beyond hosted APIs and work with open models.

    View book →

Senior and leading

Systems and leadership: designing ML systems, data infrastructure, patterns for reuse and senior technical influence.

  • Cover of Designing Machine Learning Systems

    Designing Machine Learning Systems

    by Chip Huyen · 2022

    ~390 pages~10 hrs to read

    Covers data pipelines, feature engineering, deployment, monitoring and iteration for production ML. Read it when you own a system, not just a model, and need to reason about what breaks over time.

    View book →
  • Cover of Designing Data-Intensive Applications

    Designing Data-Intensive Applications

    by Martin Kleppmann · 2017

    ~620 pages~16 hrs to read

    The standard reference on storage, replication, partitioning, transactions and stream processing. Read it once your AI features depend on databases and queues you have to reason about.

    View book →
  • Machine Learning Design Patterns

    by Valliappa Lakshmanan, Sara Robinson, Michael Munn · 2020

    ~400 pages~10 hrs to read

    Catalogues recurring solutions for data representation, training, serving, reproducibility and responsible AI. Handy when you design a pipeline and want proven patterns to compare against.

    View book →
  • Cover of The Staff Engineer's Path

    The Staff Engineer's Path

    by Tanya Reilly · 2022

    ~520 pages~13 hrs to read

    Covers technical leadership without a management title: setting direction, influencing across teams and carrying big projects. Read it when you are moving toward senior or architect-level work.

    View book →

Book links go to Amazon and are affiliate links. As an Amazon Associate I earn from qualifying purchases.

Frequently asked questions

Which book should a AI Engineer read first?

Hands-On Large Language Models by Jay Alammar, Maarten Grootendorst. It is heavily visual and gives a working picture of how language models operate before you build anything on top of them.

Do I need to read all 12 books?

No. The list is a menu, not a syllabus. Find your stage (getting started: 3, doing the job: 5, senior and leading: 4), begin with one book (we suggest Hands-On Large Language Models), then pick the next book by the problem you are facing at work. Come back to the others when the situation they cover arrives.

How long does it take to read these books?

The 9 books with a known page count add up to about 4,310 pages, roughly 108 hours at 1.5 minutes a page. At three hours a week that is about 36 weeks; at six hours a week, about 18. The list is meant to be read over time, one book at a time, not in one run.

Are these books up to date?

They range from 2017 (Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow) to 2025 (AI Engineering). Older titles are included because they teach principles that have not changed; for tools and platforms, we favour recent editions. Check the edition before you buy.

Some links are affiliate links: we earn a small commission if you buy, at no cost to you. It does not change what we list.