8 results for “local inference”
AMD, Super Micro Computer and Spectro Cloud have jointly unveiled AMD Instinct Coder, a turnkey enterprise AI coding platform designed to give. Enterprise AI coding has moved from individual developer experimentation to a platform-level.
Hugging Face released @huggingface/kernels with 207 versioned WebGPU kernels and the Fleet benchmarking tool for browser-based AI. The kernels beat ORT WebGPU by 2.57× geometric mean on Apple M4, creating a shared performance foundation for local inference.
PyTorch Foundation, Hugging Face, IBM, and Mitsubishi Electric will host PyTorch Day Japan 2026 in Tokyo on December 10.
Oasis Security researchers disclosed CVE-2026-65105 in NVIDIA NemoClaw: configuring host Ollama on 0.0.0.0:11434 for sandbox reachability disables a key Host-header defense, letting a malicious webpage reach the unauthenticated API via DNS rebinding and rewrite the model chat template. NVIDIA credited the finders in its August 2026 NemoClaw and OpenShell security bulletin.
NVIDIA released the PAIR beta on September 3, 2026, letting local AI agents route inference across RTX PCs, DGX Spark, and Macs on a home network. The router works with Ollama and LM Studio without agent changes.
SenseTime has released the preview version of SenseNova U1.5-Lite-Preview, a lightweight unified multimodal model that packs 8 billion. The release arrives at an inflection point where the multimodal model competition is shifting from raw.
Liquid AI has released the LFM2.5 model family, a comprehensive suite of open-weight models designed to run entirely on edge devices without cloud. The LFM2.5 releases address three critical constraints that have limited on-device AI.
NVIDIA has introduced two new Jetson Thor modules aimed at bringing more capable AI workloads to robots and edge devices. The Jetson T3000 and T2000 are designed for systems that need to process vision, language and sensor data locally.