llmfleet: pool many agents' turns into one Batch API call and save 50 percent

A fleet-level batch dispatcher that pools Anthropic messages.create across coroutines, routes interactive calls to sync and patient calls to Batch.

Read Original

Related