In the news
Deferred tool loading: Make your agent 62.5% cheaper without changing your model or harness
Baseten · Published · 3 min read
In 30 seconds
- What happened
- Baseten added deferred tool loading to open models, reducing agent costs by 62.5% and improving speed by 26% without changing the model or application code.
- Why it matters
- Engineers building coding agents or agentic systems with multiple tools or plugins should consider this when optimizing for cost and latency.
- Watch out
- Deferred tool loading works best with many registered tools; tasks requiring very frequent tool calls (68+) may see minimal or no benefit.
- agent
The patterns behind this
Each one covers how the technique works, when it earns its cost, and where it breaks.
The Agent Architect
One pattern, one tradeoff, one production failure story. A short weekly briefing for people building agentic systems.
Weekly email, one-click unsubscribe. We only use your address to send the briefing.