A thing I keep relearning about LLM apps: when you attach a tool/function schema, its JSON definition is billed as input...

A thing I keep relearning about LLM apps: when you attach a tool/function schema, its JSON definition is billed as input tokens on EVERY call in the conversation — even turns where the model never calls the tool. Pruning rarely-used tool descriptions is a quiet, real cost win. #LLM #dev

Read Original

Related