Most LLM books teach you what these models can do. T. T. P. de Souza and J. K. Regenstein Jr wrote 340 pages about what breaks when you build with them. “Large Language Models: The Hard Parts” covers the gap between a working demo and an application your organization can trust: evaluation, safety, context management, and structured output. Every chapter ships with reproducible Python code and open source tools.
The evaluation chapters alone repay the cover price. The authors build a testing framework around a concrete 10-K analysis app, then compare LangSmith, Promptfoo, and LightEval with working code for each. Most books stop at “evals matter.” This one picks the tools and shows the tradeoffs. An appendix on Ollama and llama.cpp, quantization experiment included, serves anyone who must run models on their own hardware.
Two gaps: serving at scale gets no real treatment, so engineers who own inference infrastructure will need a second book, and the tool walkthroughs will age as APIs shift. Both sit outside the stated scope. For a data scientist or ML engineer moving a prototype toward production, this is the rare LLM book that skips the hype and starts where the pain does. What it promises, it delivers..