modular-arithmetic tasks

Cross-Trajectory Chimera Interventions Reveal Dissociable Roles of Weight Magnitude and Direction in Grokking

Researchers introduce 'cross-trajectory chimera interventions' to isolate and test the causal portability of weight direction versus magnitude across independently trained neural networks on grokking tasks, finding direction encodes transferable circuit identity while norm governs susceptibility to overwrite.