“Now that organisations have been weaned off earlier 'all you can eat' #subscription plans and onto 'pay-as-you-go' metered #token consumption, they're all in various stages of sticker shock. Several talks at the conference discussed managing token costs, such as AJ Fisher's exploration of 'diffusion' models. Analogous to the diffusers used to generate images, they generate text at lighting speed, making them cheaper to operate while also being less accurate than the pricey and slower “autoregressive” #FrontierModels.Fisher's solution? Use a low-quality model and make it iterate on a problem (that new classic, the #RalphWiggumLoop) until it gets a satisfactory solution. This approach delivers the same result as a full-fat model, for anywhere from one half to one tenth the spend. #Google released its #DiffusionGemma model, which produces text at prodigious speed, just days after Fisher's talk, giving everyone the ability to try this approach.” — #MarkPesce#AI / #ArtificialIntelligence /...
“Now that organisations have been weaned off earlier 'all you can eat' #subscription plans and onto 'pay-as-you-go' mete...
