Open Source · Hacker News ·
Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
Cactus open-sourced Needle, a 26M-parameter function-calling model for consumer devices. The team says it was pretrained on 200B tokens and post-trained on synthesized tool-use data, and that it can run at high token speeds on-device.