Tools · Hacker News ·
Petals: Run LLMs at home, BitTorrent-style
Petals is a system for running large language models across users’ computers, using a BitTorrent-style network to share model layers. It aims to make models that are difficult to run on a single home computer accessible through distributed hosting.