9 results for “AI inference”
OpenAI opened a preview of Ultrafast, an API tier that runs GPT-5.6 Sol up to 14 times faster on Cerebras wafer-scale chips. The mode targets enterprise workloads like incident response and financial analysis with up to 750 output tokens per second.
A developer known as slvDev has demonstrated a 28.9-million-parameter language model generating text at 9.88 tokens per second on an ESP32-S3. Running a language model on a sub-$10 microcontroller changes the cost floor for local AI.
Nvidia has formally opened the cuFile APIs and the vertical storage stack beneath them, moving the interface that lets GPUs read and write storage. Opening cuFile is a strategic departure; this layer has historically lived inside CUDA.
AMD, Super Micro Computer and Spectro Cloud have jointly unveiled AMD Instinct Coder, a turnkey enterprise AI coding platform designed to give. Enterprise AI coding has moved from individual developer experimentation to a platform-level.
Cloudflare has open-sourced Cloudflare OS, an AI agent workspace originally built to run its own global workforce, making the platform available for any. Enterprise AI adoption has largely split into two unsatisfying paths: generic chat.
DeepSeek's next flagship model, DeepSeek V4, appears to be on track for an official launch on August 3, 2026, according to multiple converging signals. The competitive landscape DeepSeek V4 enters is markedly different from the one.
AI model costs are forcing OpenAI, Meta, xAI and other major labs to shift their sales pitch from raw capability toward cheaper intelligence per task. Enterprise AI bills have become a board-level concern.
AMD has officially launched its Helios AI rack-scale system, marking the company's most aggressive move yet to challenge Nvidia's dominance in. The Helios launch signals a structural shift in the AI infrastructure landscape.
Advanced Micro Devices (AMD) shares rose sharply on Monday after the company announced a major expansion of its strategic partnership with Microsoft (MSFT). This announcement is a critical validation for AMD's AI strategy.