SPIN Unprocessed October 27, 2026 ai_technology research
Conceptizer: Next-Token Prediction Is Not All You Need
View original on arxiv.orgOverview
arXiv:2610.33027v1 Announce Type: new Abstract: Next-token prediction (NTP) rewards only the token that occurs next, penalizing every alternative. But natural language often offers many ways to express the same meaning. We introduce Conceptizer, a training framework that extends next-token prediction with a reward for meaning. Conceptizer uses a fixed, model-agnostic vocabulary of ~9K concepts, built from contextual synonyms, as units of meaning alongside tokens as units of text. It maps each ne
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from arXiv Computation and Language
View all →- Each Insufficient in Its Own Way: Calibrating Language Models Across Varying Evidence States
- Position, Role or Label? A Controlled Study of Instruction Conflicts in LLM Agents
- Parametric Session States Recover Retrieval Intent without Replaying History
- EviGround-CT: Sentence-to-Volume Grounding for Verifying LLM-Generated Chest CT Reports
- A Benchmark for Controllable Speaking-Style Captioning in Audio-Language Models
- Mine or Yours? Mind-Bridged Language Models Take Each Other's Memories as Their Own
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO