SPIN Unprocessed October 25, 2026 ai_technology community
I ran a blind test on self-hosted AI agents. Here are the results, guess who's who [D]
View original on reddit.comOverview
everything here ran on my own hardware, an M5 Max MacBook Pro with 64GB. blind test of self-hosted AI agents, every one on Qwen 3.8 27B uncensored Q4_K_M in llama.cpp, same 5 everyday tasks like counting log errors and renaming a function. names hidden, results below, take a guess The tasks Merge two contact lists, messy emails, two different Alex Kims. All 5 got it right (46 people). Rename a function across 3 files with messy spacing. All 5 passed. Fix a bug, with hidden tests. 4 passed. C tur
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from Reddit r/MachineLearning
View all →- Deepity: a hand-tuned C++/CUDA predictive coding library, beats jpc (JAX) and ngc-learn on MNIST (CPU benchmarks + source inside) [P]
- Practical notes on setting up a GPU kernel-dev environment: CUDA 13's GPU cutoff, async timing pitfalls, profiler counter permissions [P]
- What is the value proposition of "RL environment" companies? [D]
- Papers with Code is now open-source [P]
- How to do method research when I feel I have no guidance on doing it? [D]
- Stenosis detection in coronary angiograms, need recall over precision [D]
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO