Models · Hacker News ·
Show HN: Maple-Preview – Ternary 20B MoE running at 120 tok/s on a iPhone
Maple-Preview is a ternary 20B mixture-of-experts model reported to run at 120 tokens per second on an iPhone. The project was submitted to Hacker News as a Show HN post.