[Paper] GEAR: Guided End-to-End AutoRegression for Image Synthesis

Summary

Visual generative models are typically trained in two stages. A tokenizer is first trained for reconstruction and then frozen, after which a generator is trained on its discrete indices or continuous latents. This decoupling leaves the tokenizer unaware of what the generator finds easy to model. We present GEAR (Guided End-to-end AutoRegression), which trains a vector-quantized (VQ) tokenizer and an autoregressive (AR) generator jointly and end-to-end, guided by representation alignment. The key

SpinGraph analysis pending — check back after processing.

• Concurrency plus nvfp4 on Blackwell
• 5060 worth it?
• Getting close to 100K context on 32GB VRAM with Qwen3.6-27 at Q8
• I benchmarked 13 models at 65K-128K context to find out what actually matters for agentic workloads
• PSA: Upscaling Gemma 4 requires a proportional layer_scalar adjustment
• Using "applications" to make a smaller model more effective at bigger tasks.