Office Comprehension Benchmark

Summary

arXiv:2607.01245v1 Announce Type: new Abstract: We introduce Office Comprehension Bench (OCB), the first public benchmark to jointly evaluate LLM systems on Word, Excel, and PowerPoint comprehension over native file formats (.docx, .xlsx, .pptx) and their variants. OCB consists of two tracks. File Fidelity Q&A tests structural and visual perception of office artifacts - tables, charts, embedded images, formulas, and app-specific elements such as headers, speaker notes, and named ranges. Domain Q

SpinGraph analysis pending — check back after processing.

• Can Language Models Actually Retrieve In-Context? Drowning in Documents at Million Token Scale
• Parameter Golf: What Really Works?
• From Monolingual to Multilingual: Evaluating Mamba for ASR in South African Languages
• Comparing Architectures for Supervised Political Scaling
• Grounded Optimization: A Layered Engineering Framework for Reducing LLM Hallucination in Automated Personal Document Rewriting
• FaithMed: Training LLMs For Faithful Evidence-Based Medical Reasoning