Back in Q1 I read a headline about Google cutting AI memory use 6x and filed it under "watch and revisit." Four months later, Google still hasn't shipped official code, but a whole ecosystem of forks has, llama.cpp has an open PR, and at least one compatibility gotcha lands squarely on our daily driver. Here's the honest state of TurboQuant heading into Q3, and the test I'd actually run against it.
TurboQuant, Four Months Later: Chasing Google's 6x VRAM Claim Into the Wild