RepoRadar
Leave a Tip
Item detail

maximhq/bifrost

Bifrost is an Apache-2.0 enterprise AI gateway that unifies access to 23+ providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex, and more) through a single OpenAI-compatible API. 5.8k stars, claims 50x faster than LiteLLM with sub-100µs overhead at 5k RPS, Go-based core, ships automatic failover, adaptive load balancing, semantic caching, guardrails, and a web UI for visual config and real-time

Open source →Back to radar
Score8.3
Popularity80.0
Riskconditional
TierGold
Score breakdown
Usefulness9.0
Novelty7.0
Momentum9.0
Maturity8.2
Open-source/build8.4
Evidence7.2
Workflow potential9.4
Setup ease8.8

Popularity is tracked separately. Support, ads, sponsorships, and tips never affect these signals.

Why it matters

Useful for platform and infra teams that need one gateway fronting every model provider with failover, load balancing, and observability already wired in. Install via `npx -y @maximhq/bifrost` or Docker, point your OpenAI-compatible clients at http://localhost:8080, and route by model prefix (openai/, anthropic/, bedrock/).

Who should use it

platform teams that want one OpenAI-compatible endpoint fronting every model providerSRE / infra engineers building failover and load balancing for LLM trafficengineering teams tired of hand-rolling LiteLLM wrappers and provider-specific retry logiccompliance teams that need a single chokepoint to enforce prompt / response guardrailsproduct teams running semantic caching to cut repeat-prompt costs

Who should skip it

Skip if the source link, docs, or setup requirements do not match your workflow.

Risk explanation

API keys for every provider pass through the gateway — treat the gateway as a credentialed service and follow standard secret-management practices; claims of '50x faster than LiteLLM' are vendor benchmarks; validate against your own workload before committing.

Evidence links

Closest alternatives / related signals

ai-gatewaylitellm-alternativeopenai-compatiblefailoverload-balancingsemantic-cacheguardrailsgo