Launch HN: Magnitude (YC S25) – Self-optimizing inference engine for agents

За 30 секунд

Что произошло

Magnitude is an open source inference engine that optimizes itself for your hardware, running open models up to 2x faster than llama.cpp.

Почему это важно

Matters for engineers running local AI agents who want faster inference on their existing hardware without cloud costs or data leaving their machine.

На что обратить внимание

Performance gains vary by hardware: 92% faster on Metal, only 19% on CUDA. Optimization only applies to supported model families, not all open models.