Retrieval-augmented & hybrid systems

Как проходит обучение

Components may be trained separately or jointly: dual encoders learn retrieval, rerankers learn pairwise relevance, and generators learn grounded response behavior. Many practical RAG systems use pretrained components without end-to-end training.

Как выполняется инференс

A query may be rewritten or routed; multiple retrievers produce candidates; filters and a reranker select evidence; the model answers from a bounded context. Citation correctness requires checking that claims are actually supported.

Сильные стороны

• •Fresh, private, or attributable knowledge without weight updates
• •Evidence can be inspected and access-controlled
• •Indexes and generators can evolve independently

Компромиссы

• •Bad chunking or retrieval creates confident answers from missing evidence
• •Ingestion freshness, permissions, and deletion become production systems
• •Retrieved content can carry prompt injection or poisoned data

Использовать, когда

• Answers depend on changing or proprietary sources
• Users need traceable evidence
• Recall, ranking, grounding, and answer quality can be evaluated separately

Избегать или пересмотреть, когда

• The corpus is tiny enough for a deterministic lookup
• No trustworthy source exists
• Adding a vector database is being treated as a complete RAG design