Technology
Tencent Open-Sources AngelSpec Framework for Efficient LLM Inference
Tencent open-sources AngelSpec, a unified training framework that uses workload-aware strategies — multi-token prediction for dialogue and block diffusion for code and math — to boost LLM inference throughput across concurrency levels 4-64.
Read more →