Item detail
github.com

Inference Gateway — a self-hosted OpenAI-compatible router that can expose MCP tools only when enabled

RepoRadar surfaced Inference Gateway — a self-hosted OpenAI-compatible router that can expose MCP tools only when enabled — a developer tool — into the AI Gateway section, where it sits at Gold tier with a 'try now' verdict. Its strongest signal is workflow potential, scored 8.9 out of 10.

Score7.8
Popularity100.0
Riskconditional
TierGold
Score breakdown
Usefulness8.0
Novelty7.0
Momentum8.0
Maturity8.7
Open-source/build8.4
Evidence7.2
Workflow potential8.9
Setup ease6.4

Popularity is tracked separately. Support, ads, sponsorships, and tips never affect these signals.

Why it matters

Useful for teams that want to standardize LLM routing, metrics and provider access without wiring every app to every vendor separately. It matters most when the gateway is treated as sensitive infrastructure, not just a convenience proxy.

Where this stands now

Inference Gateway — a self-hosted OpenAI-compatible router that can expose MCP tools only when enabled ranks #7 of 10 tracked AI Gateway items by composite score (7.8 against a section median of 7.9). The section currently carries 6 Gold, 4 Silver. Signal extremes versus the section: novelty at the 30th percentile.

Who should use it

teams routing several LLM providers behind an OpenAI-compatible API developers adding MCP tools to provider requests but needing an off switch and per-request bypass platform engineers who want Prometheus/OpenTelemetry visibility on LLM traffic

Who should skip it

Move on from Inference Gateway — a self-hosted OpenAI-compatible router that can expose MCP tools only when enabled if the licensing terms, language support, or platform requirements do not fit your project.

About this signal

Inference Gateway — a self-hosted OpenAI-compatible router that can expose MCP tools only when enabled is tracked by RepoRadar as a developer tool in the AI Gateway section. First seen —; the source record was last checked on 2026-09-06. The current verdict is 'try now' with a Gold tier and moderate setup difficulty. Inference Gateway — a self-hosted OpenAI-compatible router that can expose MCP tools only when enabled leads on workflow potential (8.9) and maturity (8.7); its lowest signal is setup ease (6.4), so factor that in before investing setup time. This page summarizes the public evidence on the linked source page and states where additional review is still needed.

How this item is evaluated

The Inference Gateway — a self-hosted OpenAI-compatible router that can expose MCP tools only when enabled record combines a 7.8/10 composite score with separate popularity (100.0), risk (conditional), and setup (moderate) signals. See the scoring methodology for the current weights and evidence definitions.

Questions worth asking before you adopt this

Putting this into practice? Read How to vet an AI agent or MCP server before you wire it in for the checklist behind this score.

Risk explanation

Provider API keys and routing policy live at the gateway boundary. A bad deployment can centralize access to multiple paid or sensitive model providers; Provider-native proxying can forward requests beyond the standardized API surface. Restrict credentials and network exposure before use; MCP middleware lets model calls reach configured tools when enabled. Keep MCP_ENABLED and MCP_EXPOSE off until each tool server is reviewed; Telemetry and audio endpoints are opt-in according to the README, but production deployments still need normal retention, access-control and data-handling review.

Evidence links
Closest alternatives / related signals
llm-gateway openai-compatible-api mcp provider-routing observability docker kubernetes open-source
Verification record

What RepoRadar actually verified

Discovered

Automated discovery and source capture. Last checked 2026-09-17T21:45:13.795340Z.

No editorial or hands-on review is claimed. This record remains at Discovered.

Verification sources

Longitudinal intelligence

How this decision record is moving

Raw history JSON →

6 dated snapshots retained from 2026-09-08 through 2026-09-17; see the snapshot index for explicit coverage gaps. Stars, version, release, pricing, integration, risk, maintenance, verdict, score, and momentum fields remain explicit even when a source has not reported them. Repository momentum is a normalized 0–10 RepoRadar signal; GitHub stars appear only where the popularity monitor retained exact timestamped observations.

RepoRadar score7.8 current · +0.0 net
Repository momentum9.0 current · +0.0 net
GitHub stars (observed)214 current · +3 net
GitHub stars214 exact observation
Versionv0.53.0
Last release2026-09-16T12:25:40Z
Maintenanceactive
Current riskconditional
Current verdicttry now
Pricing baselineNo structured commercial pricing baseline
Pricing checkedNot applicable or not recorded
Pricing freshnessNo dated commercial pricing review
Integrations baselineAnthropic, Model Context Protocol, OpenAI, OpenTelemetry

Recent dated points

DateScoreMomentumStarsRiskVerdictMaintenance
2026-09-177.89.0214conditionaltry nowactive
2026-09-157.89.0212conditionaltry nowactive
2026-09-137.89.0212conditionaltry nowactive
2026-09-127.89.0212conditionaltry nowactive
2026-09-117.89.0212conditionaltry nowactive
2026-09-087.89.0211conditionaltry nowactive

Why the record changed

stars changed

Stars changed: 213 → 214.

version changed

Version changed: v0.52.0 → v0.53.0.

stars changed

Stars changed: 212 → 213.

version changed

Version changed: v0.51.3 → v0.52.0.

stars changed

Stars changed: 211 → 212.

new entity

Newly added to RepoRadar's decision catalog.