Streaming usage, cache token semantics, serverless flushes, cancelled streams, stale price tables — the five metering bugs I hit building LLM cost tracking, with fixes for each.
Five ways your LLM cost tracking is lying to you
Streaming usage, cache token semantics, serverless flushes, cancelled streams, stale price tables — the five metering bugs I hit building LLM cost tracking, with fixes for each.
Yesterday afternoon I was about to ship a change to a production pipeline. The code was written,...
Point the Codex CLI at OpenAI's GPT-5.6 Luna, Terra, and Sol on Amazon Bedrock with two lines of config, using the AWS credentials you already have.
Meet SocialRadar: a daily and weekly research agent built with the Strands SDK, Bedrock AgentCore,...