Bonsai 27B (1-bit LLM): The First 27B-Class Model to Run on a Phone

Bonsai 27B introduces a 1-bit 27B-class LLM designed to run locally on phones, pushing mobile inference limits.

Categories: Model Releases

Read at source: https://prismml.com/news/bonsai-27b