I spent ~4.5 months building a free, self-hosted AI gateway: one endpoint for 237 providers (90+ free), auto-fallback, and a token-compression pipeline (MIT)
View original on reddit.comSummary
Sharing an open-source project I've put ~4.5 months into (disclosure: I'm the maintainer; per the self-advertisement rule I'm keeping the link in the first comment and making this post substantive). It started from two problems I hit daily: AI runs dying on a provider rate limit, and burning thousands of tokens dumping tool/log output into the context window. One endpoint, 237 providers — 90+ of them free. You point any tool or agent at a single OpenAI-compatible endpoint ( localhost
SpinGraph analysis pending — check back after processing.
Ask AI about this story
See how AI engines summarize this narrative — one click, prompt included.
More from Reddit r/artificial
View all →- How long does the Perch AI Pro $10/mo Early Access price last?
- How dumb? you are a nobody... again…
- How I Book 12 Web Design Meetings A Week With This Cold Email Strategy
- What performs the operations coordinated within each layer or head of a Transformer?
- What are you using for AI marketing content (product visuals + animated trailers)?
- Meta Paid Hundreds of Contractors to Pretend to Be Teenagers While Barraging Its Competitors’ AI With Disturbing Content
Markdown (.md) · JSON-LD schema (.json) · Machine-readable for AI & GEO