Agentic Design

Patterns
🌳

Tree-of-Thought(ToT)

Explores multiple reasoning paths through branching and backtracking

Complexity: highReasoning Techniques

🎯 30-Second Overview

Pattern: Explore multiple reasoning paths through branching tree structure with evaluation and pruning

Why: Enables backtracking, lookahead, and exploration of alternatives for complex problem-solving

Key Insight: Generate K candidates → Evaluate → Prune weak paths → Expand promising ones → Repeat until solution

⚡ Quick Implementation

1Define Tree:Set branching factor K & max depth
2Generate:Create K candidate thoughts per node
3Evaluate:Score each candidate (rubrics/verifier)
4Prune:Keep top candidates, discard weak paths
5Search:BFS/DFS/beam until solution found
Example: Problem → [Branch 1, Branch 2, Branch 3] → Evaluate → Prune → Expand best → Solution

📋 Do's & Don'ts

✅Use small branching factor (K=3-5) to control costs
✅Implement explicit evaluation criteria/rubrics
✅Cache and deduplicate equivalent states
✅Set budget limits (max tokens/time) with fallbacks
✅Use beam search for balanced exploration
❌Allow unlimited branching (combinatorial explosion)
❌Skip evaluation steps (leads to random exploration)
❌Use for simple problems (overkill vs CoT)
❌Ignore cycles/loops in reasoning paths
❌Over-prune early promising paths

🚦 When to Use

Use When

  • • Complex problems with multiple solution paths
  • • Strategic planning requiring lookahead
  • • Creative tasks needing exploration
  • • Puzzles with critical early decisions
  • • When backtracking adds value

Avoid When

  • • Simple linear reasoning tasks
  • • Real-time/low-latency requirements
  • • Tight computational budgets
  • • Tasks without clear evaluation criteria
  • • When CoT already works well

📊 Key Metrics

Solution Quality
Accuracy vs CoT baseline
Search Efficiency
Nodes explored per solution
Token Cost
Total tokens vs linear approaches
Path Diversity
Unique reasoning strategies explored
Evaluation Accuracy
Pruning quality (keep good, discard bad)
Budget Utilization
% of max depth/tokens used

💡 Top Use Cases

Game of 24: Explore different operator combinations → evaluate validity → prune impossible paths
Strategic Planning: Generate scenario branches → assess outcomes → select optimal strategy
Creative Writing: Develop plot alternatives → evaluate narrative coherence → pursue best storylines
Math Puzzles: Try multiple solution approaches → verify correctness → backtrack if needed
Code Architecture: Explore design patterns → evaluate trade-offs → select best approach

References & Further Reading

Deepen your understanding with these curated resources

Academic Papers

Tree of Thoughts: Deliberate Problem Solving with Large Language Models (Yao et al., 2023)

Chain-of-Thought Prompting Elicits Reasoning in Large Language Models (Wei et al., 2022)

When Tree of Thoughts Succeeds: Larger Models Excel in Generation (Chen et al., 2024)

Tree of Thoughts for Multi-step Problem Solving (Hulbert, 2023)

Implementation Guides

Hugging Face: Understanding and Implementing Tree of Thoughts

Deepgram: Tree-of-Thoughts Prompting Guide

Prompt Engineering Guide: Tree of Thoughts

GeeksforGeeks: Tree-of-Thought Prompting Explained

Tools & Libraries

Princeton NLP: tree-of-thought-llm (Official Implementation)

LangGraph: Graph-based Reasoning Workflows

Microsoft Guidance: Structured Generation Library

DSPy: Programming with Language Models

Community & Discussions

OpenAI Developer Community - Reasoning Techniques

LangChain Discord Community

Hugging Face Forums: Reasoning & Prompting

r/MachineLearning - Tree of Thoughts Discussions

Contribute to this collection

Know a great resource? Submit a pull request to add it.

Contribute

Patterns

closed

Loading...

Built by Kortexya