Models · The Decoder ·
Tencent releases Hy3 open-source model that allegedly matches models up to five times its active size
Tencent has released Hy3, an open-source language model with 295 billion parameters that uses a mixture-of-experts design, activating 21 billion parameters per query. The company says it performs comparably to models two to five times larger and has a hallucination rate of 5.4 percent.