Parameter Golf: What Really Works?

Summary

arXiv:2607.01517v1 Announce Type: new Abstract: How far can a language model improve under a strict artifact budget? Parameter Golf posed this question as an open community challenge in which participants trained the best language model, with the complete artifact (training code + compressed weights) required to fit within 16 MB and be trained in under ten minutes on 8xH100 SXM GPUs. Quality was measured in bits-per-byte (BPB), the average number of bits required to encode each byte of unseen te

SpinGraph analysis pending — check back after processing.

• Can Language Models Actually Retrieve In-Context? Drowning in Documents at Million Token Scale
• From Monolingual to Multilingual: Evaluating Mamba for ASR in South African Languages
• Comparing Architectures for Supervised Political Scaling
• Grounded Optimization: A Layered Engineering Framework for Reducing LLM Hallucination in Automated Personal Document Rewriting
• FaithMed: Training LLMs For Faithful Evidence-Based Medical Reasoning
• IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMs