Blog
Technical deep-dives on LLMs, RAG, agents, and machine learning from Data For Science.
Jev 101
A new class of model
Local LLM Inference at Scale with vLLM
Continuous batching, prefix caching, and structured outputs: the vLLM features that turn a single local model into a serving engine for thousands of requests.
The Epidemiology of a Cognitive Virus
What happens when you take "LLM addiction" seriously enough to write down the equations and run simulations
LLMs Are the New Wikipedia
Every old criticism is new again.
An MCP Server from Scratch
Interact with a database with the latest version of the MCP Protocol
Evaluating your Agentic Harnesses
One good demo is a test flight. An eval suite is the flight-test campaign: pass rates, cost, latency, and failure modes.
Self hosting LLMs with Llama.cpp
Install, download, and serve a small model on Apple Silicon, then read the model file's guts — including the arithmetic for working out whether a given model fits in your RAM.
Building an Advanced Agentic Harness
From a single pilot to an air campaign: planning, parallelism, memory, verification, and observability for production-shaped agents.
Build a (small) language model by counting
A 4-gram model on WikiText-103, and the one idea it shares with Claude.
Building a Basic Agentic Harness
The secret sauce behind Claude Code, Open Clawd, Hermes, etc