11 results for “rack-scale”
AMD launched its Helios rack-scale AI system at Advancing AI 2026, combining 72 MI455X GPUs with 18 EPYC Venice CPUs to challenge Nvidia's Vera Rubin platform. The system will begin shipping to customers including Microsoft, Meta, and OpenAI later in 2026.
NVIDIA published Day-0 FP8 inference results for Alibaba's 2.4T-parameter Qwen3.8-2.4T-A95B on the GB300 NVL72 rack, hitting over 4,000 tokens per second per GPU. The result demonstrates that rack-scale NVLink can absorb MoE all-to-all traffic at frontier model scale.
NVIDIA's Vera Rubin NVL72 achieves up to 30x higher throughput per megawatt than GB300 NVL72 on the SemiAnalysis AgentX benchmark, which replays real coding-agent sessions. The gain comes from rack-scale co-design across GPUs, CPUs, NVLink fabric, and the Dynamo serving stack for agentic AI workloads.
Advanced Micro Devices (AMD) shares rose sharply on Monday after the company announced a major expansion of its strategic partnership with Microsoft (MSFT). This announcement is a critical validation for AMD's AI strategy.
AMD has agreed to invest up to $5 billion in Anthropic under a sweeping infrastructure agreement that ties the chipmaker's equity commitment to. The agreement underscores a shifting dynamic in AI infrastructure procurement: major model.
NVIDIA validated Alibaba's Qwen3.8-Flash-Next 176B MoE model on its GB300 NVL72 rack, achieving over 16K tokens per second per GPU. The hybrid GDN/QSA architecture keeps memory and compute bounded for million-token agentic coding workloads.
NVIDIA published a practical observability framework mapping telemetry tools to every layer of DGX and HGX AI factory infrastructure. The guide helps teams catch gray failures like InfiniBand bit-error drift before they waste multi-hour training runs.
NVIDIA's Groq 3 LPX accelerator hit 3,431 output tokens per second on the Artificial Analysis 100K context benchmark with Gemma 4 31B. The result enables responsive multi-agent systems that can process full session histories at long context lengths.
NVIDIA hand-delivered its first Vera CPUs to Anthropic, OpenAI, SpaceXAI, and Oracle Cloud Infrastructure in mid-May 2026, correcting earlier reports of late August shipments. The 88-core Olympus processor targets agentic AI workloads where CPU orchestration gates GPU utilization.
NVIDIA launched NVLink Fusion with NVHBM on August 26, 2026, giving hyperscalers a standardized path to deploy custom XPUs alongside NVIDIA GPUs. The co-designed memory and interconnect stack promises 30% higher bandwidth, 25% more compute area, and 15% lower HBM power versus standard HBM4e.
OpenAI published measured Jalapeño inference results (1.5–1.9× performance per watt on InferenceX) and, in a companion full-stack strategy post, detailed how chips, partners, data centers, and serving software compound to lower the cost of useful intelligence.