Search results for "GPU kernels"

Technology 01 Sep 2026

Hugging Face launches @huggingface/kernels with 207 WebGPU kernels for local browser AI

Hugging Face released @huggingface/kernels with 207 versioned WebGPU kernels and the Fleet benchmarking tool for browser-based AI. The kernels beat ORT WebGPU by 2.57× geometric mean on Apple M4, creating a shared performance foundation for local inference.

Technology 02 Sep 2026

PyTorch 2.14 ships nccl2, NVGEMM, and fault-tolerant c10d — with a Mac decode fix

On 2 September 2026 the PyTorch Foundation released 2.14: nccl2 and NVGEMM land in-tree, fault tolerance becomes a first-class c10d feature, and Apple Silicon gains native linear algebra plus Metal kernels that close an 8.5× single-token decode gap versus the prior MPS path.

Technology 28 Aug 2026

NVIDIA ships TensorRT Model Connect: Hugging Face checkpoint to native C++ inference in two commands

NVIDIA released TensorRT Model Connect in public preview, turning Hugging Face checkpoints into native C++ TensorRT bundles with two commands and no ONNX step. The aarch64-only wheels target robotics and edge teams on ARM-based NVIDIA hardware.