So many benchmarks. MMLU, SWE-bench, ARC-AGI, etc. Yet none of them measure what I actually notice at work.Introducing: SorryBench™.The basis: how often does a model apologize per productive session?Method: I worked, and I counted. n=1, vibes-based, not peer-reviewed. About as rigorous as half the charts in current model cards.independent-wire.org#LLM #AI #FOSS
So many benchmarks. MMLU, SWE-bench, ARC-AGI, etc. Yet none of them measure what I actually notice at work.Introducing: ...