Open source Self-hostable free
LicenseMIT
PriceFree
UsageNo model cost
Model supportmulti
Languagespython
GitHub stars52.6k
Last activity2026-07-04
Verified2026-06-28
Verified byseed
An open-source proxy and SDK that unifies 100+ LLM providers behind a single OpenAI-compatible API, with built-in cost tracking, budget alerts, routing, fallbacks, rate limiting, and caching. Runs as a Python library or a standalone proxy server.
Strengths
- Unified API across every major provider and open model
- Cost tracking, budget alerts, and spend limits per project or user
- Fallback chains and load balancing across providers
Tradeoffs
- Broad surface area; many features to configure
- Some advanced features require the paid CloudUI tier