How SWE-Serve Exposes the Gap Between Local Tests and Live Serving

За 30 секунд

Что произошло

SWE-Serve benchmark reveals that AI coding patches pass local tests 69.4% of the time but only 45.9% when live serving checks are included.

Почему это важно

Engineers building inference-serving systems need this when evaluating AI agents for production-grade changes to LLM serving software like SGLang.

На что обратить внимание

SWE-Serve tests only SGLang on single H100 or CPU; results may not generalize to other inference engines, multi-GPU setups, or different hardware configurations.