The Problem With General-Purpose LLMs in Healthcare Ask a general-purpose LLM about the...
Fine-Tuning Llama 3.2 3B on Medical QA: Week 1 Setup and Baseline Inference
Related
Porting Gemma-4 12B (the encoder-free multimodal one) to AWS Inferentia2
The 12B ships as a multimodal class with no encoder loaded, and its sliding-window attention overflows Neuron's fused-attention SBUF. Three surgical fixes and it serves Paris at ~1...
My Inferentia port matched its reference token-for-token — and still output garbage
Porting Gemma-4 31B (dense) to AWS Inferentia2: the tensor-parallel recipe that worked at 12B collapses at 31B, NxD ModelBuilder saves it — and then a passing validation lies to yo...
Porting a 128-expert MoE (Gemma-4 26B-A4B) to AWS Inferentia2 — where every rank weighted the wrong experts
The MoE was the hard one: a dual-path FFN, a sparse expert loop that won't trace, and a bug where the device output was empty while the CPU reference was perfect and every unit tes...