Item detail

BerriAI/litellm

BerriAI/litellm is a production-ready proxy and toolkit that normalizes calls across 100+ LLM providers while adding observability and guardrails.

Score9.0
Popularity97.0
Riskconditional
TierGold
Score breakdown
Usefulness9.0
Novelty8.0
Momentum9.0
Maturity9.0
Open-source/build8.4
Evidence7.2
Workflow potential10.0
Setup ease4.2

Popularity is tracked separately. Support, ads, sponsorships, and tips never affect these signals.

Why it matters

Useful if you need a single, auditable routing layer instead of wiring each model provider separately.

Who should use it

builders shipping multi-vendor AI productsplatform teams managing provider costs and quotasops teams standardizing LLM observability

Who should skip it

Skip if the source link, docs, or setup requirements do not match your workflow.

Risk explanation

Gateway errors can become system-level failure points; protect provider credentials and test failover and allowlisting before production.; The repository includes mixed licensing paths (MIT for core, check enterprise paths before bundling).

Evidence links

Closest alternatives / related signals

llmgatewaymulti-providerobservabilitycost-control