Comparison

LiteLLM vs Portkey

A like-for-like, spec-level comparison. Both entries are verified against their docs and repo.

LiteLLM

Open-source LLM gateway with cost tracking, routing, and fallbacks.

  • + Unified API across every major provider and open model
  • + Cost tracking, budget alerts, and spend limits per project or user
  • + Fallback chains and load balancing across providers
  • − Broad surface area; many features to configure
  • − Some advanced features require the paid CloudUI tier

Portkey

AI gateway with caching, fallbacks, and observability.

  • + Caching and fallbacks that survive provider outages
  • + Unified logging across all providers in one dashboard
  • + Self-hostable gateway with a managed cloud option
  • − Newer ecosystem than LiteLLM
  • − Managed cloud is the revenue layer; OSS is the gateway core
Spec LiteLLM Portkey
Role LLM gateway LLM gateway
Tags llm-gateway, library, persona-platform-engineer llm-gateway, persona-platform-engineer
License MIT MIT
Open source Yes Yes
Self-hostable Yes Yes
MCP support No No
Pricing free freemium
Price Free Free tier
Usage cost No model cost No model cost
Models multi multi
Languages python typescript
GitHub stars 52.6k 12.3k
Last activity 2026-07-04 2026-05-25