Where Should a Document Live: Context, Representations, or Parameters?

За 30 секунд

Что произошло

Researchers compared three methods for giving LLMs access to new documents: context windows, fine-tuned parameters, and cached representations, finding representation-based methods most accurate.

Почему это важно

Engineers building retrieval-augmented systems or knowledge-intensive applications need to choose between in-context, parametric, and representation injection approaches.

На что обратить внимание

Representation methods show catastrophic forgetting on unrelated tasks, degrading performance by six percent generally and thirteen percent on coding benchmarks.