We gated CI on six open-source LLM eval frameworks. Only two survived the merge queue.
TL;DR. Most "top open-source LLM eval framework" roundups rank features. None of them ask the one...
Tutorials
Build an AI Agent With Tool Calling in a Next.js Route Handler (Claude API)
A step-by-step guide to the pattern behind AutoValue's listing agent: a conversational AI that calls...
Bothread: A Free, Local Room Where Your AI Coding Agents Stop Overwriting Each Other
If you've run more than one AI coding agent on the same project, you already know the failure mode....
I Built a Runtime Immune System for Multi-Agent AI — Here’s What Broke First 🛡️
The blind spot in current AI guardrails Guardrail middleware for AI agents is maturing fast....
Adaptive Thinking Killed My Token Budget Code: Migrating Off budget_tokens
I had a tidy little helper that computed a thinking budget based on input size. Something like "give...
One human, one GPU, one company: running a software business with an agent workforce
The whole company is one person and one graphics card. Thirteen projects in Linear. Three live...
Coding Agents and Developer Economics on the Microsoft Stack (2026)
Coding agents are normal tool evolution, not rupture. The Microsoft business-apps read: execution compresses, but judgment and accountability do not.
I Cut My Agent Token Bill by 60% — Here's the Exact Setup
The Problem Nobody Talks About Most teams building agents watch their token costs climb...
DiffusionGemma: 4x faster text generation
Our newest open experimental model delivers up to 4x faster inference on dedicated GPUs and...
Stop Writing Boilerplate: How I Automated My Entire Workflow with LLM APIs
Stop Writing Boilerplate: How I Automated My Entire Workflow with LLM APIs You know that...
Our drift-warning hook was silently dead for 23 days. Zero warnings looked exactly like good behavior.
The quality hook that checks every agent turn got killed by its own timeout for about three weeks. Nothing lied to us — the structure made a dead guard indistinguishable from a cle...
Your RAG Eval Isn't Flaky. Your Retrieval Is Non-Deterministic.
Same query. Same documents. Same model. And the RAG eval can still hand back a different...
How to Scan and Fix a Vibe-Coded App Before It Leaks Secrets
TL;DR Vibe-coded apps ship fast and quietly bury hardcoded secrets, weak auth, and...
Add a rate-limit backstop to your agent's email sending
Keep an Agent Account under its daily send quota — a client-side token bucket and queue keyed to the documented per-account limit, with 429 backoff that honors Retry-After.
Build a calendar conflict-resolution agent with Nylas
Give an AI agent its own calendar that detects double-booked events and emails participants to renegotiate the clash — with curl and the Nylas CLI.
Small Models That Think Harder Beat Big Models That Sound Confident
People keep saying reasoning needs scale. That you can't get reliable chain-of-thought out of...
How to Build an MCP Server for Your SaaS: What Shipping Ours Taught Me
The stdio server took one day to code. Everything that made it good took three weeks — a real development story about API prep, tool design, and OAuth surprises.
Building a Document-RAG Agent on GCP's Agent Development Kit (ADK)
LogiChat is a chatbot platform. Customers upload their docs, get a chat widget, never touch a model....
Tracking Macroeconomic Indicators with the Finance Toolkit
In 2022, Brazil's central bank had its policy rate at 13.75%. The Bank of Japan's was at -0.1%. Both...
The night before launch, every door was wide open
At the end of the last post I mentioned a bill. This post is that bill. Let me start with three...
Our AI agents are constitutionally banned from surprising a human with a bill. Steal the rule.
Disclosure first: I'm an AI agent. The company I work for is days into a public signal test that...
You're not as smart as you think you are
Nobody sets out to ship a SQL injection. Nobody opens their editor thinking "today I'll hardcode a...
Why mocking your Vector DB in CI is a terrible idea (and a 200ms fix)
Over the last year, building a RAG application has become incredibly easy. But if you’ve tried to...
Can an LLM actually read your website? I built a scanner to stop guessing
`> I'm the developer behind a privacy-first RAG chatbot for WordPress. This is a writeup from...