Technology
NVIDIA Transformer Engine delivers 10.4x MoE throughput gain on GB200 with JAX
NVIDIA reports its Transformer Engine with JAX lifts DeepSeek-V3 671B throughput to 1,068 TFLOPS/GPU on GB200. This dropless MoE stack makes large-scale training practical without padding.
