9 results for “B200”
NVIDIA's NIM 2.0.12 stack boosts Nemotron 3 Ultra throughput to 1,997 tokens per second on four B200 GPUs, a 2.5x gain at 50 TPS per user. Enterprises can replay this profile using AIPerf.
NVIDIA Dynamo now offers a preview shadow engine recovery feature that cuts LLM failover from 283 seconds to 7.3 seconds on B200 GPUs. The GPU Memory Service keeps weights resident across process crashes, letting a pre-warmed standby take over almost instantly.
NVIDIA's AVO agent architecture achieved a perfect 100% score on the ARC-AGI-3 public benchmark, completing all 183 levels across 25 environments. The result shows system-level design — not model scale alone — can unlock long-horizon autonomous reasoning that stumped every frontier model.
NVIDIA launched DSX MaxLPS, a full-stack platform that dynamically reallocates stranded power across GPU racks to fit up to 40% more compute in the same facility envelope. The system combines real-time power steering, workload-aware profiles, and 45°C liquid cooling to boost performance per watt by 1.3–1.5x on Blackwell and Vera Rubin systems.
NVIDIA has released NemotronLabs VoiceChat 11B, an 11-billion-parameter end-to-end speech-to-speech model that performs streaming speech understanding. VoiceChat 11B gives researchers and infrastructure teams a reference implementation.
LTX, the open world model company spun out of Lightricks, has released LTX-2.5 — a rebuilt video and world model that generates a 10-second, 720p clip. The release reinforces a business model bet that open weights — not closed APIs — will.
Z.ai released GLM-5.2, a 753B open-weight model with MIT licensing that matches Anthropic's Opus 4.8 on agentic benchmarks at roughly one-fifth the token cost. The 1M-context model is already running in Cursor and Claude Code, shifting enterprise leverage toward self-hosted inference.
OpenAI published measured Jalapeño inference results (1.5–1.9× performance per watt on InferenceX) and, in a companion full-stack strategy post, detailed how chips, partners, data centers, and serving software compound to lower the cost of useful intelligence.
SpaceX is making one of the largest hardware investments in AI history. SpaceX's AI ambitions go beyond its own needs.