Events

Put Error Bars on Your LLM Metrics

You ran the same eval twice and got 84.2, then 81.9. Which number goes in the report? Without error bars, every score is a coin flip dressed as a fact. In 30 minutes, learn to bootstrap a confidence interval on any metric — accuracy, cost, or latency — in 20 lines of Python. No distribution assumptions required.

Live LLM Engineering Masterclass: Production Evals, RAG, Agents & LLMOps

A hands-on 3.5-hour deep dive into production LLM engineering — covering evals, RAG, agents, prompt engineering, observability, and LLMOps. Every technique demonstrated with running code. Organized by Packt Publishing.

Prove Your Prompt Change Actually Helped

You changed a prompt. The score went up. But did it actually improve — or did you get lucky? In this free 30-minute lesson, learn how to run a proper paired test on two prompt versions, how to tell a real improvement from noise, and how to pick a sample size that settles the argument. No more gut-feel comparisons.

Production Graph RAG: Build Explainable LLM Apps with Knowledge Graphs

A deep dive into Graph RAG — combining knowledge graphs with retrieval-augmented generation to build LLM applications that are explainable, auditable, and grounded in structured data. Organized by Packt Publishing.

Automate the Boring Developer Stuff with LLMs

A four-hour hands-on workshop covering how to use LLMs to automate repetitive developer tasks — code generation, test writing, documentation, and more. Every exercise ships with working code.