The Agent Architect #43: Working Memory Patterns

Le pattern de la semaine

Working Memory Patterns

Quoi:

Maintient un ensemble limité de faits et d'objectifs actifs pendant la résolution du problème, en écartant ou en archivant les éléments moins prioritaires à mesure que la capacité se remplit.

Quand l'utiliser:

Tâches en plusieurs étapes où l'agent doit suivre les résultats intermédiaires, les objectifs courants et les contraintes sans relire tout le contexte à chaque étape.

Vigilance:

Les agents conservent souvent trop d'informations, ou les mauvaises, ce qui amène les étapes suivantes à s'appuyer sur des données périmées ou à perdre des contraintes essentielles.

Cette semaine en IA agentique

• FuTransformer: FP8 prefill and INT4 decode for Llama-style inference on HopperarXiv cs.AI

  Transformer prefill reuses weights across tokens and is dominated by matrix multiplication and activation data movement; single-token decode has limited reuse and is dominated by weight and KV-cache reads. We present FUTRANSFORMER, a CUDA implementation of a Llama-style Transformer block for NVIDIA Hopper GPUs. It applies CODA's GEMM-plus-epilogue approach to inference, adding direct KV-cache placement, folding the fixed RMSNorm gain into weights, writing FP8 output directly with delayed scaling, and supporting prefill without padding. Decode uses INT4 projection weights and an INT4 KV-cache c

• Beyond the Benchmark: Conditioning, Domains and Failure Modes of Qwen3-TTSarXiv cs.AI

  Qwen3-TTS reports state-of-the-art zero-shot voice cloning, but its technical report leaves open how the model should be conditioned, how it behaves outside read speech, and how it fails. We characterise its two cloning interfaces, in-context learning (ICL) and X-Vector, against Chatterbox, XTTS-v2 and F5-TTS on read, meeting, emotional and air-traffic-control (ATC) speech, using eighteen objective measures, an LLM judge, a spoofing countermeasure and a listening test. Neither interface dominates: ICL clones timbre more closely from correctly transcribed references, X-Vector clones timing, and

• Scaling Kimi K3 on AMD Instinct MI355X: Matching NVIDIA HGX B300 Throughput per GPU on AgentXvLLM

  Inside the Kimi K3 optimization effort: understanding the bottlenecks and the decisions that made inference faster

• Hyper Optimizing Kimi K3 in vLLM: Moving Fast and ResponsiblyvLLM

  How agent-assisted CuTe DSL optimizations accelerate Kimi K3 decode on NVIDIA GB300, and how scoped changes, correctness tests, and reproducible benchmarks help ship them responsibly.

• NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal ReasoningNVIDIA Developer

  Always-on agents are taking on longer, more complex enterprise workflows. A single request can involve reading a document, checking information across sources,... Always-on agents are taking on longer, more complex enterprise workflows. A single request can involve reading a document, checking information across sources, following company policy, and calling several tools. NVIDIA Nemotron 3.5 Super VL is an open, customizable multimodal model for these specialized workflows. Its 120B-parameter mixture-of-experts (MoE) architecture activates 12B… Source