Agentic Design

Patterns
๐Ÿ‘๏ธ

Human On the Loop(HOTL)

Human supervisory oversight of autonomous AI systems with ability to monitor, intervene, or take control when necessary

Complexity: highUI/UX & Human-AI Interaction

๐ŸŽฏ 30-Second Overview

Pattern: Human supervisory oversight of autonomous AI systems with monitoring and intervention capabilities

Why: Enables high-speed autonomous operation while maintaining human control and safety oversight for edge cases

Key Insight: Humans supervise rather than participate, intervening only when AI encounters exceptional situations

โšก Quick Implementation

1Monitor Setup:Create real-time dashboards & alert systems
2Define Boundaries:Set operational parameters & risk limits
3Exception Detection:Configure anomaly & threshold alerts
4Override Controls:Build intervention & takeover mechanisms
5Resume Automation:Enable smooth return to autonomous operation
Example: autonomous_operation โ†’ monitor_dashboard โ†’ exception_alert โ†’ human_override โ†’ resume_autonomy

๐Ÿ“‹ Do's & Don'ts

โœ…Design comprehensive real-time monitoring dashboards
โœ…Set clear operational boundaries and risk parameters
โœ…Implement fast, intuitive override mechanisms
โœ…Provide contextual information for human decisions
โœ…Test emergency takeover procedures regularly
โŒOverwhelm operators with too many alerts
โŒDesign overly complex intervention interfaces
โŒAllow autonomous operation without clear boundaries
โŒSkip training operators on override procedures
โŒIgnore human workload and attention limitations

๐Ÿšฆ When to Use

Use When

  • โ€ข High-speed autonomous operations
  • โ€ข Reliable AI with occasional edge cases
  • โ€ข Supervisory oversight requirements
  • โ€ข Need for emergency intervention capability

Avoid When

  • โ€ข Continuous human decision-making needed
  • โ€ข Unreliable or unproven AI systems
  • โ€ข Legal requirements for active human approval
  • โ€ข High-touch customer interactions

๐Ÿ“Š Key Metrics

Autonomous Operation Time
Percentage of time running without intervention
Mean Time to Detection
Average time to identify anomalies
Intervention Response Time
Time from alert to human action
False Alert Rate
Percentage of unnecessary human alerts
Successful Takeover Rate
Percentage of successful human interventions
Return to Autonomy Time
Time to resume autonomous operation

๐Ÿ’ก Top Use Cases

Autonomous Vehicles: AI drives normally, human supervisor ready to take control in emergencies with 200ms response time
Algorithmic Trading: AI executes thousands of trades autonomously, trader monitors and intervenes during market volatility
Manufacturing Automation: AI controls production line, human operators monitor quality and intervene for unusual events
Air Traffic Control: AI manages routine flight patterns, controllers oversee and intervene for complex weather situations
Content Moderation: AI automatically moderates clear violations, human moderators oversee edge cases and policy updates

References & Further Reading

Deepen your understanding with these curated resources

Contribute to this collection

Know a great resource? Submit a pull request to add it.

Contribute

Patterns

closed

Loading...