Loading patterns…

🔧

Corrective RAG (CRAG)

RAG system that automatically detects and corrects poor retrieval results through quality assessment and re-retrieval

Complexity: highKnowledge Retrieval (RAG)

In 30 seconds

What: Retrieves documents, scores their relevance, re-retrieves with refined queries when quality falls below threshold.
When to use: Retrieval-heavy tasks where initial results are often incomplete or stale, and you can afford extra API calls.
Watch out: Quality thresholds set too high trigger endless re-retrieval loops; too low defeats the purpose and wastes compute.

Ask the AI expert about this pattern

Opens the assistant with your question prefilled. You review it before sending.

Get this catalog as an MCP server Tune a prompt for this pattern

RAG system that automatically detects and corrects poor retrieval results through quality assessment and re-retrieval

Retrieval quality assessment
Automatic error detection
Corrective re-retrieval
Query refinement strategies
Knowledge source expansion
Quality-based filtering

The Agent Architect

One pattern, one tradeoff, one production failure story. A short weekly briefing for people building agentic systems.

Weekly email, one-click unsubscribe. We only use your address to send the briefing.

References

The papers, specifications, and repositories this pattern is based on.

Corrective Retrieval Augmented Generation (Yan et al., 2024)arXiv:2401.15884
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (Lewis et al., 2020)arXiv:2005.11401
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection (Asai et al., 2023)arXiv:2310.11511
Active Retrieval Augmented Generation (Jiang et al., 2023)arXiv:2305.06983
Searching for Best Practices in Retrieval-Augmented Generation (Barnett et al., 2024)arXiv:2407.01219

From the engineer behind this catalog

Get your agent architecture reviewed

This page documents one pattern. Your system runs dozens, and most failures live in how they fit together. Have the whole design reviewed against the 288 patterns in this catalog: architecture, reliability, evaluation and cost, every finding mapped to the pattern that fixes it.

€750 instead of €1,500, one week, written report and walkthrough call, until 30 September

See the review

Patterns

Loading patterns…

Design Patterns & Techniques

Loading patterns…

🔧

Corrective RAG (CRAG)

RAG system that automatically detects and corrects poor retrieval results through quality assessment and re-retrieval

Complexity: highKnowledge Retrieval (RAG)

In 30 seconds

What: Retrieves documents, scores their relevance, re-retrieves with refined queries when quality falls below threshold.
When to use: Retrieval-heavy tasks where initial results are often incomplete or stale, and you can afford extra API calls.
Watch out: Quality thresholds set too high trigger endless re-retrieval loops; too low defeats the purpose and wastes compute.

Ask the AI expert about this pattern

Opens the assistant with your question prefilled. You review it before sending.

Get this catalog as an MCP server Tune a prompt for this pattern

30-Second Overview

Pattern: Enhanced RAG with explicit retrieval quality evaluation and corrective actions based on confidence scoring

Why: Reduces hallucinations and improves accuracy through quality assessment and adaptive correction strategies

Key Insight: Three-tier correction strategy: refine high-confidence, supplement medium-confidence, re-retrieve low-confidence results

Quick Implementation

1Initial Retrieval:Retrieve candidate documents using dense/sparse/hybrid search

2Quality Assessment:Evaluate retrieval quality with confidence scoring (high/medium/low)

3Corrective Action:Refine, supplement, or re-retrieve based on confidence band

4Knowledge Refinement:Decompose and recompose evidence for optimal context

5Generate & Verify:Generate response with citations and optional verification

Example: query → retrieve → evaluate_quality → [correct/supplement/re-retrieve] → refine → generate

Do's & Don'ts

✅Implement explicit retrieval quality evaluator with calibrated confidence thresholds

✅Use knowledge refinement with decompose-then-recompose for evidence processing

✅Apply web search supplementation for medium confidence retrieval results

✅Enforce strict citation requirements with provenance tracking

✅Cache evaluator outputs and refined knowledge for efficiency

❌Allow evaluator miscalibration without regular confidence score validation

❌Skip query drift prevention during corrective re-retrieval

❌Create unbounded correction loops without cost and latency controls

❌Mix outdated and fresh sources without temporal reconciliation

❌Neglect abstention mechanisms when confidence remains persistently low

When to Use

Use When

• High-stakes applications requiring verified accuracy and provenance
• Rapidly changing domains with frequent content updates
• Noisy or heterogeneous knowledge bases with quality variation
• Long-tail queries where initial retrieval often fails
• Regulated environments requiring explicit evidence grounding

Avoid When

• Real-time applications with strict latency requirements
• Closed-book tasks where parametric knowledge suffices
• High-quality homogeneous corpora with consistent recall
• Environments prohibiting external web access for supplementation
• Simple factual queries with reliable standard RAG performance

Key Metrics

Answer Faithfulness

Factual correctness and groundedness in retrieved evidence

Evaluator Calibration

Accuracy of quality confidence predictions (ROC-AUC, ECE)

Correction Effectiveness

Quality improvement from corrective actions

Retrieval Precision

Relevance of documents after correction

Citation Coverage

Percentage of claims supported by evidence

Action Distribution

Balance of use/supplement/re-retrieve decisions

Top Use Cases

Legal Research: Case law analysis requiring verified sources and temporal accuracy

Medical Q&A: Clinical decision support with evidence-based recommendations and safety checks

Financial Analysis: Market research combining real-time data with historical knowledge

Policy Research: Government and regulatory information requiring up-to-date accuracy

Technical Documentation: Software and API documentation with version-specific corrections

References & Further Reading

Deepen your understanding with these curated resources

Foundational Papers & CRAG Research

Corrective Retrieval Augmented Generation (Yan et al., 2024)

Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (Lewis et al., 2020)

Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection (Asai et al., 2023)

Active Retrieval Augmented Generation (Jiang et al., 2023)

Quality Assessment & Evaluation

Searching for Best Practices in Retrieval-Augmented Generation (Barnett et al., 2024)

RAGAS: Automated Evaluation of Retrieval Augmented Generation (Es et al., 2023)

Benchmarking Large Language Models in Retrieval-Augmented Generation

Knowledge Refinement & Processing

Lost in the Middle: How Language Models Use Long Contexts (Liu et al., 2023)

LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

Chain-of-Verification Reduces Hallucination in Large Language Models (Dhuliawala et al., 2023)

Factuality Enhanced Language Models for Open-Ended Text Generation (Lee et al., 2022)

Implementation Frameworks & Tools

LlamaIndex Corrective RAG Workflow Implementation

LangChain RAG Evaluation and Correction Chains

Haystack Document Evaluation and Reranking Components

DSPy: Optimizing LM Prompts and Weights for RAG Systems

Web Search Integration & Supplementation

Bing Search API for Real-Time Information Retrieval

Google Search API Integration for Knowledge Supplementation

Tavily Search API for AI Applications

You.com Search API for Developer Integration

Production Deployment & Monitoring

LangSmith: Production Monitoring for RAG Applications

Weights & Biases: Experiment Tracking for CRAG Systems

Arize: Retrieval Evaluation

Neptune: Experiment Management for RAG System Optimization

RAG system that automatically detects and corrects poor retrieval results through quality assessment and re-retrieval

Retrieval quality assessment
Automatic error detection
Corrective re-retrieval
Query refinement strategies
Knowledge source expansion
Quality-based filtering

The Agent Architect

One pattern, one tradeoff, one production failure story. A short weekly briefing for people building agentic systems.

Weekly email, one-click unsubscribe. We only use your address to send the briefing.

References

The papers, specifications, and repositories this pattern is based on.

Corrective Retrieval Augmented Generation (Yan et al., 2024)arXiv:2401.15884
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (Lewis et al., 2020)arXiv:2005.11401
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection (Asai et al., 2023)arXiv:2310.11511
Active Retrieval Augmented Generation (Jiang et al., 2023)arXiv:2305.06983
Searching for Best Practices in Retrieval-Augmented Generation (Barnett et al., 2024)arXiv:2407.01219

From the engineer behind this catalog

Get your agent architecture reviewed

€750 instead of €1,500, one week, written report and walkthrough call, until 30 September

See the review

Loading patterns…

Corrective RAG (CRAG)

In 30 seconds

Ask the AI expert about this pattern