#Transformer

LLM attention is limited. Starting from the difference in weighting between system and user prompts, this article explores the Lost in the Middle phenomenon and what it can teach us.