Models · MarkTechPost ·
Moonshot AI Releases Kimi K3: A 2.8 Trillion Parameter Open MoE Model With Kimi Delta Attention and 1M Context
Moonshot AI released Kimi K3, a 2.8-trillion-parameter open mixture-of-experts model. It uses Kimi Delta Attention and Attention Residuals, activates 16 of 896 experts, and supports a 1-million-token context window.