SPIN Unprocessed July 30, 2026 ai_technology research
Knowledge before Reasoning: EC-Reason-Bench, a Training-Free Diagnostic Benchmark for LLM Enzyme Classification
View original on arxiv.orgOverview
arXiv:2607.26397v1 Announce Type: new Abstract: Enzyme function prediction is a hierarchical, knowledge-intensive form of protein function classification. Existing benchmarks expose an anomaly: general LLMs often get the coarse first level right, yet once asked for a complete EC number their accuracy at levels two through four drops to almost zero, while specialized models and tools stay usable. We propose EC-Reason-Bench, a training-free, diagnostic evaluation protocol built to answer two quest
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from arXiv Computation and Language
View all →- CMT-RAG: Complementary Memory Traces for Multi-turn Multi-hop RAG
- ForgetBench: Benchmarking Forgetting Dynamics of Long-Term Parametric Memory in Language Models
- Mergeable Model-Side Aggregation States for Long-Context Language Models
- Voice Memory for Agentic Speech Recognition
- Misalignment Has a Personality: A Big Five Account of Emergent Misalignment
- (Im)Paired Programming: Coding Agents Improve Productivity but Harm Understanding
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO