Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning

За 30 секунд

Что произошло

Researchers identified repetitive copying in long-context LLMs and developed GEAR, a reinforcement learning method that rewards grounding in relevant evidence while penalizing distractor text.

Почему это важно

Matters for engineers building or fine-tuning large language models for long-context reasoning tasks where accuracy and efficiency are critical.

На что обратить внимание

The method requires automated evidence annotation of training data, and improvements plateau at longer contexts; real-world applicability depends on annotation quality.