The Agent Architect #43: Working Memory Patterns

本周模式

Working Memory Patterns

是什么:

在解决问题的过程中只保留有限的活跃事实与目标，随着容量占满，丢弃或归档优先级较低的条目。

何时使用:

多步骤任务：智能体必须跟踪中间结果、当前目标和各项约束，又不能每一步都重读完整上下文。

注意:

智能体常常保留过多或错误的信息，导致后续步骤引用陈旧数据，或丢失关键约束。

本周智能体AI动态

• FuTransformer: FP8 prefill and INT4 decode for Llama-style inference on HopperarXiv cs.AI

  Transformer prefill reuses weights across tokens and is dominated by matrix multiplication and activation data movement; single-token decode has limited reuse and is dominated by weight and KV-cache reads. We present FUTRANSFORMER, a CUDA implementation of a Llama-style Transformer block for NVIDIA Hopper GPUs. It applies CODA's GEMM-plus-epilogue approach to inference, adding direct KV-cache placement, folding the fixed RMSNorm gain into weights, writing FP8 output directly with delayed scaling, and supporting prefill without padding. Decode uses INT4 projection weights and an INT4 KV-cache c

• Beyond the Benchmark: Conditioning, Domains and Failure Modes of Qwen3-TTSarXiv cs.AI

  Qwen3-TTS reports state-of-the-art zero-shot voice cloning, but its technical report leaves open how the model should be conditioned, how it behaves outside read speech, and how it fails. We characterise its two cloning interfaces, in-context learning (ICL) and X-Vector, against Chatterbox, XTTS-v2 and F5-TTS on read, meeting, emotional and air-traffic-control (ATC) speech, using eighteen objective measures, an LLM judge, a spoofing countermeasure and a listening test. Neither interface dominates: ICL clones timbre more closely from correctly transcribed references, X-Vector clones timing, and

• Scaling Kimi K3 on AMD Instinct MI355X: Matching NVIDIA HGX B300 Throughput per GPU on AgentXvLLM

  Inside the Kimi K3 optimization effort: understanding the bottlenecks and the decisions that made inference faster

• Hyper Optimizing Kimi K3 in vLLM: Moving Fast and ResponsiblyvLLM

  How agent-assisted CuTe DSL optimizations accelerate Kimi K3 decode on NVIDIA GB300, and how scoped changes, correctness tests, and reproducible benchmarks help ship them responsibly.

• NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal ReasoningNVIDIA Developer

  Always-on agents are taking on longer, more complex enterprise workflows. A single request can involve reading a document, checking information across sources,... Always-on agents are taking on longer, more complex enterprise workflows. A single request can involve reading a document, checking information across sources, following company policy, and calling several tools. NVIDIA Nemotron 3.5 Super VL is an open, customizable multimodal model for these specialized workflows. Its 120B-parameter mixture-of-experts (MoE) architecture activates 12B… Source