SPIN Unprocessed October 26, 2026 ai_technology research
LAMB: A Modern Contextual Language Model for Latin
View original on arxiv.orgOverview
arXiv:2610.31723v1 Announce Type: new Abstract: This article introduces Latin Modern BERT (LAMB), an encoder for the Latin language based on the ModernBERT architecture, pretrained in two phases on more than 74B Latin tokens using a novel morphologically informed masking regimen. We also present two corpora for the Latin language. Acervus contains 24B BERT WordPiece tokens, including over 760K samples from heavily damaged OCR transcriptions, repaired by a ByT5 model trained for Latin text repair
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from arXiv Computation and Language
View all →- LazyFlash: Forward-Dense, Backward-Sparse Attention for Accelerated Long-Context Fine-Tuning
- TaxoSAE: Rethinking Sparse Autoencoders through Taxonomic Logic
- Mining Frames: Association Rule Mining as an Unsupervised Framework for News Framing Detection
- Machine-Readable Operator Manuals over the ISO 11783 Network for Offline, Multilingual LLM Assistance
- Scaling cross-situational word learning on children's naturalistic experiences
- SPECMEM: Accelerating Agentic Tool Calling via Live Memory Management
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO