The Agent Architect #43: Working Memory Patterns

Паттерн недели

Working Memory Patterns

Что это:

Удерживает во время решения задачи ограниченный набор активных фактов и целей, отбрасывая или архивируя менее приоритетные элементы по мере заполнения ёмкости.

Когда применять:

Многошаговые задачи, где агент должен отслеживать промежуточные результаты, текущие цели и ограничения, не перечитывая на каждом шаге весь контекст.

Осторожно:

Агенты часто сохраняют слишком много или не те сведения, из-за чего последующие шаги опираются на устаревшие данные или теряют важные ограничения.

На этой неделе в агентном ИИ

• FuTransformer: FP8 prefill and INT4 decode for Llama-style inference on HopperarXiv cs.AI

  Transformer prefill reuses weights across tokens and is dominated by matrix multiplication and activation data movement; single-token decode has limited reuse and is dominated by weight and KV-cache reads. We present FUTRANSFORMER, a CUDA implementation of a Llama-style Transformer block for NVIDIA Hopper GPUs. It applies CODA's GEMM-plus-epilogue approach to inference, adding direct KV-cache placement, folding the fixed RMSNorm gain into weights, writing FP8 output directly with delayed scaling, and supporting prefill without padding. Decode uses INT4 projection weights and an INT4 KV-cache c

• Beyond the Benchmark: Conditioning, Domains and Failure Modes of Qwen3-TTSarXiv cs.AI

  Qwen3-TTS reports state-of-the-art zero-shot voice cloning, but its technical report leaves open how the model should be conditioned, how it behaves outside read speech, and how it fails. We characterise its two cloning interfaces, in-context learning (ICL) and X-Vector, against Chatterbox, XTTS-v2 and F5-TTS on read, meeting, emotional and air-traffic-control (ATC) speech, using eighteen objective measures, an LLM judge, a spoofing countermeasure and a listening test. Neither interface dominates: ICL clones timbre more closely from correctly transcribed references, X-Vector clones timing, and

• Scaling Kimi K3 on AMD Instinct MI355X: Matching NVIDIA HGX B300 Throughput per GPU on AgentXvLLM

  Inside the Kimi K3 optimization effort: understanding the bottlenecks and the decisions that made inference faster

• Hyper Optimizing Kimi K3 in vLLM: Moving Fast and ResponsiblyvLLM

  How agent-assisted CuTe DSL optimizations accelerate Kimi K3 decode on NVIDIA GB300, and how scoped changes, correctness tests, and reproducible benchmarks help ship them responsibly.

• NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal ReasoningNVIDIA Developer

  Always-on agents are taking on longer, more complex enterprise workflows. A single request can involve reading a document, checking information across sources,... Always-on agents are taking on longer, more complex enterprise workflows. A single request can involve reading a document, checking information across sources, following company policy, and calling several tools. NVIDIA Nemotron 3.5 Super VL is an open, customizable multimodal model for these specialized workflows. Its 120B-parameter mixture-of-experts (MoE) architecture activates 12B… Source