Lost in the middle: How LLM architecture and training data shape AI’s position bias

Lost in the middle: How LLM architecture and training data shape AI’s position bias

Research has shown that large language models (LLMs) tend to overemphasize information at the beginning and end of a document or conversation, while neglecting the middle.