Open Source · MarkTechPost ·

Tencent Open-Sources AngelSpec: A Unified Training Framework for MTP and Block-Parallel Speculative Decoding on Hy3 Models

Tencent Open-Sources AngelSpec: A Unified Training Framework for MTP and Block-Parallel Speculative Decoding on Hy3 Models

Tencent released AngelSpec, an open-source PyTorch framework for training speculative-decoding draft models across six architectures. Its DFly-8 drafter achieved 1.98–2.40× speedups over autoregressive decoding on HY3-295B-A21B at concurrency levels of 4–64.

Read the full story at MarkTechPost →