The context window is a memory leak with a marketing team. A million tokens doesn't mean the model remembers a million t...

The context window is a memory leak with a marketing team. A million tokens doesn't mean the model remembers a million tokens, it means attention gets thinner across all of them. You didn't buy more memory, you diluted the memory you had.#AI #MachineLearning #LLM #Threadverse #Tech

Read Original

Related