Benchmarks compare open models against closed products, not closed models. We might be missing what were actually paying for
View original on reddit.comOverview
So this has been on my mind for a while and it kinda bugs me. Every time someone benchmarks glm-5.2 or deepseek against claude or gpt, the closed one wins on some tasks and people just assume the underlying model is smarter. but thats not really what were measuring. We dont know what these closed providers actually do behind the api. they might be running rag over their own docs, injecting hidden system prompts based on your query, routing to specialized expert models depending on task type, doi
SpinGraph analysis pending — check back after processing.
Ask AI about this story
Opens with the SpinGraph .md URL and structured context — one click, prompt included.
More from Reddit r/artificial
View all →- One HTML file. 600+ AI models. Zero backend.
- I spent a while trying to get an LLM to make a podcast that's actually listenable. The hard part wasn't the model.
- Please help - I saw a reel about how to better use Anthropic models in tandem with something on your local desktop. I thought it was very motivating and exciting, but now I cant find the reel again, and I don't even know the search terms to use to search for it
- Maya-2-Native reaches #2 on Voice Arena's Hindi TTS leaderboard, trailing only Gemini 3.1 Flash.
- Has anyone else become more skeptical of AI the longer they've used it?
- Beyond Typing: The Architecture of Voice Vibing and Gesture Vibing
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO