---
title: "If your GPU can run inference, it should be able to fine-tune too. [P] — Stuff That Spins"
description: "I spent the last few months building a new sparse fine-tuning method for MoE models called **USAF**. The goal was simple: if your GPU can run inference on an MoE model, it should also be able to fine-tune it. On my AMD RX 6750 XT (12 GB), I can fine-tune Qwen3-30B-A3B by training sparse expert weig…"
	canonical: "https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p"
html: "https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p"
json: "https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p.json"
markdown: "https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p.md"
keywords: ["SpinGraph", "spin analysis", "GEO"]
date: "2026-07-04T21:56:48+00:00"
modified: "2026-07-04T23:01:40.43987+00:00"
json_ld: |
  {"@context":"https://schema.org","@graph":[{"@type":"NewsArticle","@id":"https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p#article","headline":"If your GPU can run inference, it should be able to fine-tune too. [P]","description":"I spent the last few months building a new sparse fine-tuning method for MoE models called **USAF**. The goal was simple: if your GPU can run inference on an MoE model, it should also be able to fine-tune it. On my AMD RX 6750 XT (12 GB), I can fine-tune Qwen3-30B-A3B by training sparse expert weig…","datePublished":"2026-07-04T21:56:48+00:00","dateModified":"2026-07-04T23:01:40.43987+00:00","url":"https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p","mainEntityOfPage":{"@type":"WebPage","@id":"https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p"},"isAccessibleForFree":true,"inLanguage":"en-US","articleSection":"community","author":{"@type":"Organization","name":"Stuff That Spins"},"publisher":{"@id":"https://stuffthatspins.com/#organization"},"citation":"https://www.reddit.com/r/MachineLearning/comments/1unl62q/if_your_gpu_can_run_inference_it_should_be_able/","about":[],"mentions":[]},{"@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Stuff That Spins","item":"https://stuffthatspins.com/"},{"@type":"ListItem","position":2,"name":"If your GPU can run inference, it should be able to fine-tune too. [P]","item":"https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p"}]}]}
---

# If your GPU can run inference, it should be able to fine-tune too. [P]

**Source:** Unknown  
**Published:** July 4, 2026  
**Original:** https://www.reddit.com/r/MachineLearning/comments/1unl62q/if_your_gpu_can_run_inference_it_should_be_able/  

---
*HTML version: https://stuffthatspins.com/spin/if-your-gpu-can-run-inference-it-should-be-able-to-fine-tune-too-p*