My LLM pipeline passed every eval. Then it started lying to users in production. Not dramatically....
My LLM pipeline passed every eval. Then it started lying to users in production.
Related
Building a Research-Grade AI Project as a Solo Developer: My Stack, Tools, and Workflow
I used to think “research-grade” meant a big lab, a cluster of GPUs, and a team of people each owning...
Building a production MCP server: How we made GoodBarber agent-ready (without the glue code)
We wanted an AI agent to manage a real production app (its content, its catalog, its push...
Building AI That People Actually Use: Lessons Beyond the Hype
Artificial Intelligence has become one of the most talked-about technologies of our time. Every day...