Originally published at dheeth.blog. Series links Part 1: Everything You Know About Scaling Web...
Before the Pod Starts: GPU Node Setup for LLMs on Kubernetes
Related
Put the LLM last: I replaced a 7B model with a tiny Go classifier
Most production AI tasks are not LLM tasks. I replaced a 7B model with a tiny 2.4 MB Go classifier: rules first, small model, LLM last.
How AI Endpoints Change the Traditional API Flow
As a backend developer, I have build hundreds of endpoints, so the typical endpoint flow is deeply...
🚨 AI Should Assist Developers, Not Define Them
Every day, I see discussions about how AI assistants and Copilot are changing software...