SPIN Unprocessed October 15, 2026 ai_technology research
From Copying to Composition: How Language Models Develop In-Context Learning
View original on arxiv.orgOverview
arXiv:2610.19113v1 Announce Type: new Abstract: In-context learning (ICL) allows language models to adapt their behavior from instructions and demonstrations in a prompt, but accuracy alone does not reveal how contextual information controls their predictions. We study the acquisition and trainability of ICL with a controlled diagnostic that separates copying a nearby demonstration from integrating information across the prompt. Across 17 models, about a third prefer the copied answer, a few are
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from arXiv Computation and Language
View all →- Copy-Paste Language Models
- Do Syntax Heads Influence Model Behavior?
- Titan-Llama: Retrofitting Pre-trained LLMs with External Neural Memory Modules
- DUALVIEW: Leveraging Broad and Output-Specific Evidence for LLM-based Multi-Output Text Regression
- Weighted Ensemble Sampling for Rare-Event Estimation in Language Models
- NEPSEE: A Double-Annotated Benchmark for Nepali Sentiment Analysis
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO