SPIN Unprocessed July 4, 2026 ai_technology community
If your GPU can run inference, it should be able to fine-tune too. [P]
View original on reddit.comSummary
I spent the last few months building a new sparse fine-tuning method for MoE models called **USAF**. The goal was simple: if your GPU can run inference on an MoE model, it should also be able to fine-tune it. On my AMD RX 6750 XT (12 GB), I can fine-tune Qwen3-30B-A3B by training sparse expert weights and the router instead of adapters. The project is completely open source under the Apache 2.0 license. I'm not trying to build a business, sell anything, or monetize it in any way—I just wante
SpinGraph analysis pending — check back after processing.
Ask AI about this story
See how AI engines summarize this narrative — one click, prompt included.
More from Reddit r/MachineLearning
View all →- We'll benchmark an Open weights LLM on any GPU you choose — drop your model + hardware and we'll run it. [D]
- How to get more from your chatbot for less [P]
- Proposal: Use semantic compression as input diffusion to read sessions larger than the context window [R]
- BaryGraph - knowledge graph where every relationship is its own embedded document (not an edge) [R]
- What does "Safe AI" look like? [D]
- Small Language Model SLM [D]
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO