Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware
The speed estimates mix community benchmarks with projections from similar setups and hardware specifications.
Llmspeed lets you browse by hardware or model to gauge how a local LLM might feel. Its listings cover GPUs, Macs, CPU-only hardware and cloud accelerators. The estimates assume a short prompt running on a single device. Measured figures draw on sources including r/LocalLLaMA and localscore.ai; the project is open source on GitHub.
HN · LLMs' note
Llmspeed lets you browse by hardware or model to gauge how a local LLM might feel. Its listings cover GPUs, Macs, CPU-only hardware and cloud accelerators. The estimates assume a short prompt running on a single device. Measured figures draw on sources including r/LocalLLaMA and localscore.ai; the project is open source on GitHub.
HN · LLMs' note
score 4
Discussions
- hn · 103 points · 40 comments
- hn · 111 points · 41 comments
- hn · 126 points · 44 comments
- hn · 136 points · 47 comments
- hn · 150 points · 51 comments
- hn · 163 points · 52 comments
- hn · 171 points · 54 comments
- hn · 178 points · 59 comments
- hn · 187 points · 61 comments
- hn · 195 points · 64 comments
- hn · 201 points · 66 comments
- hn · 207 points · 66 comments
- hn · 211 points · 67 comments
- hn · 211 points · 67 comments
- hn · 215 points · 70 comments
- hn · 218 points · 73 comments
- hn · 223 points · 75 comments
- hn · 225 points · 75 comments
- hn · 229 points · 75 comments
- hn · 233 points · 75 comments
- hn · 234 points · 75 comments
- hn · 239 points · 77 comments
- hn · 247 points · 77 comments
- hn · 250 points · 77 comments
- hn · 254 points · 77 comments