In the news
LangSmith LLM Gateway: runtime governance built into the agent lifecycle
LangChain · Published · 3 min read
In 30 seconds
- What happened
- LangChain released LangSmith LLM Gateway, a runtime governance layer that enforces spend limits and redacts PII before LLM requests are sent.
- Why it matters
- Teams running agents in production need to prevent cost overruns and data leaks without adding separate infrastructure or switching between tools.
- Watch out
- Gateway is currently in public beta. Long-term roadmap includes tool calls and MCP servers, suggesting current scope is LLM calls only.
Listen to this summary
- agent
- llm
The patterns behind this
- MCP Gateway (Tool Federation & Governance)
- Tool Misuse Prevention Pattern
- Context Lifecycle Management
Each one covers how the technique works, when it earns its cost, and where it breaks.
The Agent Architect
One pattern, one tradeoff, one production failure story. A short weekly briefing for people building agentic systems.
Weekly email, one-click unsubscribe. We only use your address to send the briefing.