Search

NVIDIA NeMo Switchyard Routes AI Agent Workloads Across Models to Cut Cost and Latency

NVIDIA released NeMo Switchyard, an open-source library that routes AI agent steps across models to balance cost, latency, and accuracy. LangChain benchmarks show 74% cost savings with a 6-point accuracy tradeoff when routing between a 30B model and Claude Opus 4.8.