Last month, the LiteLLM supply chain attack exposed API keys across thousands of developer...
Rate limiting your LLM API is useless. Here's what actually protects you.
Related
Wiring a Model into SolonCode: Dialects, the apiUrl Rules, and the Timeouts Nobody Warns You About
SolonCode ships with no model. That is a deliberate product choice, not an omission: no bundled...
AirLLM Runs a 70B Model on a 4GB GPU. It's True, and That's Not the Interesting Part
AirLLM's README opens with a line that sounds like it can't be true: AirLLM dramatically reduces...
From "token" to "MoE": the LLM glossary in dependency order
TL;DR — A glossary to actually understand the terms you hit when reading about LLMs: token,...