13 results for “MoE model”
NVIDIA released Nemotron 3.5 Lightning, a 30B MoE model with 3B active parameters built for high-volume agent execution. The open model cuts inference cost for always-on agents by handling routine tool calls while frontier models focus on planning.
Alibaba's Qwen team released Qwen3.8-Flash-Next, a 125B-parameter multimodal MoE model with 6B activated parameters and 51B N-gram embeddings. The open-weight preview of Qwen4's architecture cuts training cost to one-ninth of its predecessor while leading coding and office-task benchmarks.
Tencent open-sourced an extreme quantized GGUF build of its 770B Hunyuan Hy4 model, compressing 1.5TB weights down to 214GB. By varying precision from 1.31-bit on non-critical layers to 2+ bits on sensitive layers, the model fits on accessible multi-GPU nodes.
DeepSeek V4 Flash is positioned as a fast, lower-cost open-weight AI model for developers who need long-context reasoning without paying frontier-model. The model is described as a Mixture-of-Experts system with 284 billion total.
NVIDIA validated Alibaba's Qwen3.8-Flash-Next 176B MoE model on its GB300 NVL72 rack, achieving over 16K tokens per second per GPU. The hybrid GDN/QSA architecture keeps memory and compute bounded for million-token agentic coding workloads.
Tencent open-sourced Hy4 preview, a 770B-parameter MoE model with 49B activated weights and a 1M-token context window. The Apache 2.0 release puts a frontier-class model within reach of self-hosted inference stacks.
AMD, Super Micro Computer and Spectro Cloud have jointly unveiled AMD Instinct Coder, a turnkey enterprise AI coding platform designed to give. Enterprise AI coding has moved from individual developer experimentation to a platform-level.
NVIDIA's BioNeMo Agent Toolkit now runs inside Anthropic's Claude Science, letting AI agents orchestrate protein structure prediction with MSA Search, OpenFold3, and Boltz-2 NIM microservices. The benchmark shows paired MSA input is essential — interface confidence collapses from ~0.85 to ~0.15 without evolutionary alignment.
NVIDIA and CrowdStrike validated a closed-loop agentic cybersecurity system where red and blue agents iterate at machine speed using Nemotron models. The open-model pipeline achieved a 41.9% mean detection rate in backtesting and generalized to 45% of unseen live-fire attacks, outperforming a proprietary frontier system.
NVIDIA released NeMo Switchyard, an open-source library that routes AI agent steps across models to balance cost, latency, and accuracy. LangChain benchmarks show 74% cost savings with a 6-point accuracy tradeoff when routing between a 30B model and Claude Opus 4.8.
NVIDIA has released NemotronLabs VoiceChat 11B, an 11-billion-parameter end-to-end speech-to-speech model that performs streaming speech understanding. VoiceChat 11B gives researchers and infrastructure teams a reference implementation.
Mistral AI has released Shieldstral, a 3-billion-parameter open-weight content moderation model that the company says matches the safety performance. Content moderation has traditionally forced a trade-off between coverage and cost.