I've been building NestAI for the past few months — a platform that deploys private Ollama + Open...
How I built an OpenAI-compatible API layer on top of Ollama (and what broke along the way)
Related
Google Expands Gemini Notebook With Visible Thinking Steps and Workspace Integration
Google is expanding its notebook-based research experience into Gemini Notebook, a more integrated...
Micro-compaction: amortizing context compression in agent loops
If you've run a long agent session in any framework, you've hit the wall: context fills up, the...
One Long Prompt Shouldn't Freeze Everyone's Tokens: Prefill/Decode Disaggregation
A single long-context prompt can stall every other user's token stream through head-of-line blocking. Prefill/decode disaggregation splits serving into two pools and cuts p99 inter...