Open Source · MarkTechPost ·
Soofi Consortium Releases Soofi S 30B-A3B: An Open Hybrid Mamba-Transformer MoE Foundation Model For German And English
The Soofi Consortium released Soofi S 30B-A3B, an open hybrid Mamba-Transformer mixture-of-experts model for German and English. It contains 31.6 billion parameters and activates 3.2 billion per input.