SPIN Unprocessed October 31, 2026 ai_technology research
Seq@K: Evaluating Language Models Under Sequential Feedback
View original on arxiv.orgOverview
arXiv:2610.37859v1 Announce Type: new Abstract: Language-model agents differ fundamentally from prior intelligent systems in their ability to learn from natural language in context. This capability enables agents to iteratively refine their answers in response to feedback, a prevalent mode of operation in modern agentic workflows. However, the community primarily ranks models by metrics such as Pass@1 or Pass@K, which cannot capture how they utilize feedback on prior attempts. We introduce Seq@K
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from arXiv Artificial Intelligence
View all →- SkillMem: Compact External Skill Memory for Latent Multi-Agent Reasoning
- Understanding Large Language Models as Numerical Optimizers
- GARDEN: Generalist Autonomous Reward Design Through Evidence Navigation for Cooperative Multi-Agent Reinforcement Learning
- VerifiedLab: Harnessing Knowns for Unknowns
- SciGame: Let Agents Play the Scientific Discovery Games in the Real and Counterfactual World
- Beyond Low-Pass Dynamics: Frequency-Selective Spiking Reservoirs with Resonant Neurons
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO