Dear Reader,

Welcome to the Nov 13th edition of the Data Science Briefing.

Finding the right item is still the hard part. A new paper trains small networks once, offline, to route each query to its best match in a vector database. On 2.6 million passages, routing hits 95 percent recall in 1.74 milliseconds, against 3.36 for the standard method. The web faces the same problem from the reader’s side. Search engines once sent people out to the rest of the internet. Chatbots now answer in place. The column asks whether the open web survives that change. Agents need retrieval of their own, and an engineering post maps how agent memory works. In one game test, an older model wrote 413 files and earned one badge. A newer model kept 10 files and earned four. An offline pass called dreaming rereads old transcripts and fixes bad notes.

Reasoning looks more like search than logic. Each answer is one path through token space. Training raises the odds that some path lands on the right answer. The gains from longer thinking come from search done in training and stored in the weights. Image models walk a path from noise to structure. On 6,000 handwritten digits, a small flow beats a Gaussian baseline by 105.6 nats per image. A small diffusion model draws recognizable digits in 25 steps. An essay compares AI to the Homeric songs. It calls today’s agents “more than stochastic parrots and stranger than machine gods.” Freelance work is getting rebuilt from parts. In 43 of 63 categories, tasks common in chatbot use lost share of job postings, and rarer tasks gained. AI-related postings grew 45 percent more varied in task mix and carry bigger budgets.

Half the stack gets the same result with less work. A new clustering method matches 25 epochs of k-means in under 3. It sorted 10 billion image embeddings into 16 million clusters in 2.5 epochs. Zeroing fewer than 0.05 percent of a model’s weights matches full fine-tuning. The model forgets less than it does under full fine-tuning. A model that writes text in coarse-to-fine layers matches strong diffusion models at 10 to 31 times the speed. The rest is about fit. One paper searches for the best prompt for each model and task and lifts accuracy about 9 points on average. A personal health agent, built from 1,370 real health queries, splits its work among three specialists for data, medicine, and coaching. Detectors will keep missing slop, a new comment argues. Slop is a judgement a community makes, not a property of the text.

Our latest book recommendation is “Build with Claude Code” by T. Jo. In this week’s video, we have an OpenAI Decisions API Full Tutorial for beginners.

Data shows that the best way for a newsletter to grow is by word of mouth, so if you think one of your friends or colleagues would enjoy this newsletter, go ahead and forward this email to them. This will help us spread the word!

Semper discentes,

The D4S Team