A team runs 500 prompts against a new model endpoint, records p99 latency of 8.4s, and files a...
Canary an LLM Evaluation Harness With Queue Overload and a Concurrency Gate
Related
The Circuit Breaker Pattern for AI Agents
A circuit breaker for AI agents is an automatic control that pauses an agent the moment a measured condition crosses a threshold (too many errors, too…
The pleasing effect: why AI grades your CV on a curve
I recently wrote about the halo effect associated with AI: the idea that a model that is good at one...
Sandbox First: A Throwaway-Server Workflow for Probing Where AI Coding Agents Break Their Boundaries
My last two posts here were about scoring free coding models before committing to them — build a...