SPIN Unprocessed October 27, 2026 ai_technology research
The Social World Model Evaluation Gap
View original on arxiv.orgOverview
arXiv:2610.33014v1 Announce Type: new Abstract: A negotiation assistant can reach a good deal without accurately predicting the other person's response. We ask whether evaluations of social world models test that prediction directly. We audit 113 works published from 1999 to 2026. 9 primary evaluations measure a real person's response to an action selected by the system or experimenter. Only 2 also compare an explicit response forecast with that response. Their predictors use information availab
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from arXiv Computation and Language
View all →- Each Insufficient in Its Own Way: Calibrating Language Models Across Varying Evidence States
- Position, Role or Label? A Controlled Study of Instruction Conflicts in LLM Agents
- Parametric Session States Recover Retrieval Intent without Replaying History
- EviGround-CT: Sentence-to-Volume Grounding for Verifying LLM-Generated Chest CT Reports
- A Benchmark for Controllable Speaking-Style Captioning in Audio-Language Models
- Conceptizer: Next-Token Prediction Is Not All You Need
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO