Architecture, decisions, and benchmarks from building an open-source memory evaluation framework for AI agents.
How We Built memeval: A Testing Framework for AI Agent Memory
Related
OpenEval: Why LLM Evaluation Needs a Standard Format
Every LLM evaluation framework today invents its own test case format, its own grader definitions,...
Building an AI-Powered Innovation Wormhole: Transferring Solutions Across Industries Instead of Reinventing Them
Innovation is often described as the creation of something entirely new. In reality, many...
Testing AI Coding Agents Beyond Code Generation: A Real-World Benchmark
1. Introduction Most public demonstrations of AI coding agents begin with an empty...