gemma4 e2b is really good, what other small models work on crappy computers?
View original on reddit.comSummary
I run it on i5 6500 and I get 9t/s its really fast and the output is a lot better than ChatGPT 3.5 and maybe its as good as ChatGPT 4 but I didn't use that 4.0 much. What are other good small models? I used Qwen 3.5 4b before this and that one blew me away too. submitted by /u/InsideYork [link] [comments]
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from Reddit r/LocalLLaMA
View all →- Concurrency plus nvfp4 on Blackwell
- 5060 worth it?
- Getting close to 100K context on 32GB VRAM with Qwen3.6-27 at Q8
- I benchmarked 13 models at 65K-128K context to find out what actually matters for agentic workloads
- PSA: Upscaling Gemma 4 requires a proportional layer_scalar adjustment
- Using "applications" to make a smaller model more effective at bigger tasks.
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO