Petals: Run LLMs at home, BitTorrent-style
Petals offers distributed LLM inference across home machines, making large-model execution possible through peer-to-peer resource sharing.
Excerpt
HN · 102 points · 31 comments
Read at source: https://petals.dev/