SPIN Unprocessed October 15, 2026 ai_technology research
Evaluating Large Language Models for Multilingual Abstractive Summarization: A Comprehensive Study of English and Bengali
View original on arxiv.orgOverview
arXiv:2610.19003v1 Announce Type: new Abstract: Abstractive summarization remains challenging across languages, where linguistic quality and factual consistency may diverge, particularly in low-resource settings. We present a standardized zero-shot benchmark of eight closed-source and open-weight LLMs on size-matched English and Bengali XL-Sum test sets. Our evaluation combines lexical and semantic metrics with reference-free factuality verification and multidimensional LLM-as-a-Judge assessment
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from arXiv Computation and Language
View all →- Copy-Paste Language Models
- Do Syntax Heads Influence Model Behavior?
- Titan-Llama: Retrofitting Pre-trained LLMs with External Neural Memory Modules
- DUALVIEW: Leveraging Broad and Output-Specific Evidence for LLM-based Multi-Output Text Regression
- Weighted Ensemble Sampling for Rare-Event Estimation in Language Models
- NEPSEE: A Double-Annotated Benchmark for Nepali Sentiment Analysis
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO