Lango la AI Bure & Chanzo-Wazi

Usikome Kuandika Msimbo.

Route across 352 providers through one OpenAI-compatible endpoint, with automatic fallback.

Start with Cheaper Inference Self-host OmniRoute

352 providers
90+ free tiers
15–95% eligible tokens saved

OpenAI-compatible Free and open source59.6k stars

6 models

Direct list prices compared with Cheaper Inference prices by model
Model	Input price	Output price	Savings
gpt-5.6-lunaOpenAI · text	~~$0.20~~$0.08/ 1M tokens	~~$1.20~~$0.48/ 1M tokens	60% off
gpt-5.6-solOpenAI · text	~~$2.00~~$1.00/ 1M tokens	~~$10.00~~$5.00/ 1M tokens	50% off
glm-5.3Z.ai · text	~~$1.40~~$0.77/ 1M tokens	~~$4.40~~$2.42/ 1M tokens	45% off
deepseek-v4-flashDeepSeek · text	~~$0.083~~$0.05/ 1M tokens	~~$0.18~~$0.11/ 1M tokens	40% off
deepseek-v4-flash-0731DeepSeek · text	~~$0.067~~$0.04/ 1M tokens	~~$0.18~~$0.11/ 1M tokens	40% off
glm-5.3-flashZ.ai · text	~~$0.071~~$0.05/ 1M tokens	~~$0.24~~$0.17/ 1M tokens	30% off

Ahadi

Endpoint moja. Usiache kujenga.

Usikutane na mipaka kamwe

Anguko la kiotomatiki kati ya watoa huduma 339 kwa millisekunde. Kota imekwisha? Mtoa huduma mwingine anachukua. bila kukatika.

Okoa hadi 95% ya tokeni

A 12-engine pipeline reduces eligible context by 15–95%. The documented tool-heavy example reduced it by ~89%.

$0 kuanza

90+ free tiers and 56 recurring or keyless free-forever providers. No credit card needed for the keyless quick start.

35 supported integrations

Mawakala 16+ wa uandishi wa nambari. Claude Code, Codex, Cursor, Cline, Copilot, Antigravity. kupitia usanidi mmoja.

Endpoint moja

Tafsiri ya OpenAI ↔ Claude ↔ Gemini ↔ Responses API. Elekeza zana yoyote kwenye /v1 na inafanya kazi.

Kiwango cha uzalishaji

Vizuizi vya mzunguko, TLS stealth, MCP (zana 105), A2A, kumbukumbu, vizuizi, tathmini. imehifadhiwa na majaribio 25,000+.

Katalogi

All behind one endpoint.

A catalog spanning chat, media, search, local runtimes, cloud agents and system integrations.

352 providers

14 Search12 Audio-only2 Upstream proxy3 Cloud agent1 System

25OAuthClaude Code, Codex, Cursor, GitHub Copilot, Kimi Code…

233API keyOpenAI, Anthropic, Groq, NVIDIA, Cerebras, Mistral…

35Web cookieChatGPT Web, Claude Web, Gemini Web, Grok Web…

14LocalOllama, LM Studio, vLLM, llama.cpp…

13No authenticationOpenCode Free, Felo, Pollinations and other keyless routes…

Explore the provider reference

Inafanya kazi ndani ya sekunde 60

Amri tatu. Usanidi sifuri.

Install the package, launch the gateway, then point any OpenAI-compatible client at port 20128.

Provider catalog: 352
Routing strategies: 19
Local endpoint: :20128/v1

Step 1: Install

Install the `omniroute` npm package globally.

omniroute: install

$ npm install -g omnirouteadded 1 package

Step 2: Run

Launch the API and dashboard together on port 20128.

omniroute: run

$ omniroute▸ dashboard ✓ http://localhost:20128/dashboard▸ api ...... ✓ serving on :20128

Step 3: Connect your tool

Use `http://localhost:20128/v1`; the keyless `auto` route works on a fresh install.

omniroute: connect

$ curl localhost:20128/v1/models✓ models listed

Betri zimejumuishwa

Kila kitu kimejengwa ndani. Bila nyongeza.

Uelekezaji, ustahimilivu, upunguzaji wa hisa za bure, ukandamizaji na itifaki za wakala. faili moja, bila programu-jalizi za kuunganisha.

Mchanganyiko Mahiri

Set a model to `auto` or build your own combo with 19 strategies and tiered fallback.

Use a ready-made mode or combine 19 strategies around the goal that matters.

Kumbukumbu

Kumbukumbu ya mazungumzo inayoendelea. utafutaji wa maneno muhimu FTS5 + vekta Qdrant, imejengwa ndani.

3-layer resilience

Shindwa katika kiwango sahihi. si kila kitu. Kivunjio cha mzunguko kwa mtoa, kupumzika kwa muunganisho, kufungwa kwa modeli. Funguo na modeli zingine zinaendelea kutoa huduma.

Hisa Bure

Pool-deduped accounting across 90+ free tiers.

~1.51B tokeni bure kwa mwezi.

Ukandamizaji

12 composable engines for tool output, context and response style.

Reduce eligible tokens by 15–95%.

Seva ya MCP

A built-in server exposing 110 gateway tools across 33 scopes.

110 tools · 33 scopes · stdio / HTTP

Itifaki ya A2A

A JSON-RPC agent server with 6 skills.

6 skills · JSON-RPC 2.0 · Agent Card

CombosResilienceFree quotaCompressionMCPA2AMemoryProxy controlsGuardrailsCloud agentsEvalsSemantic cacheSkillsAnalytics

Client compatibility

Keep your existing coding tools.

Point an OpenAI-compatible CLI or editor at one local base URL; OmniRoute handles the providers behind it.

Claude Code

Codex CLI

Cursor

Cline

GitHub Copilot

Gemini CLI

OpenCode

Kilo Code

Factory Droid

Continue

Roo Code

Antigravity

Aider

OpenClaw

Goose

Grok Build

Windsurf

Devin CLI

http://localhost:20128/v1

request.sh

curl http://localhost:20128/v1/chat/completions \
  -H "Authorization: Bearer $OMNIROUTE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"auto","messages":[{"role":"user","content":"Hello"}]}'

Mpya

Sasa katika VS Code Copilot Chat yako

Sakinisha kiendelezi cha OmniCopilot na kila modeli ya OmniRoute itaonekana moja kwa moja kwenye kichagulio cha modeli unachotumia tayari. hakuna upau mpya wa pembeni, hakuna kiolesura kipya cha mazungumzo.

Official Marketplace

Works in VS Code stable and Insiders. Install from the Marketplace or Extensions view.

Open VSX Registry

Kwa matoleo mengine ya VS Code yasiyotumia duka rasmi. Cursor, Windsurf, VSCodium, Theia, code-server, Gitpod na mengineyo.

Hakuna mpango wa Copilot unaohitajika

Tangu VS Code 1.122, modeli za watoa huduma zinafanya kazi bila kuingia GitHub au usajili wa Copilot. agent mode, uitaji wa zana na uoni, kwenye modeli za bure za OmniRoute.

VS Code Marketplace Open VSX Registry OmniCopilot source

Ukweli wa kila siku

Kwa Nini OmniRoute

Kila maumivu ya AI ya uandishi msimbo yana suluhisho lililojengwa ndani. Bila hati za amri, bila uangalizi.

Without routing

With OmniRoute

Quota expires unused

Track and drain the allowance you already have

Rate limits stop you mid-task

4-tier auto-fallback in milliseconds

Tool output burns tokens

12-engine compression, 15–95% on eligible content

Expensive APIs add up

Cost-optimized routing can pick the cheapest eligible target

Each tool needs its own setup

One endpoint and one dashboard

A provider is unavailable from your network

Proxy scopes and client-fingerprint controls

One dead key breaks a provider

Breaker, cooldown and lockout isolate the failure

A team shares one subscription

Key pools and fair-share quotas

You need local control of routing data

Local-first storage with encrypted credentials

No spend or health visibility

Usage, quota, savings and latency analytics

1. Subscription2. API key3. Cheap4. Free

Ulinganisho wa kweli

Jinsi tunavyolinganishwa

Capabilities checked against the linked project documentation on 2026-08-30.

Capability	OmniRoute (opens in a new tab)	9Router (opens in a new tab)	LiteLLM (opens in a new tab)	CLIProxyAPI (opens in a new tab)
Providers	352	40+	100+	8+ upstreams
Routing strategies	19	3-tier	retry / priority	round-robin / fill-first
Tiered fallback with UI	Yes	Yes	Manual policy	Multi-account
Token compression	12 engines · 15–95%	RTK / Headroom / Caveman	No built-in pipeline	HTTP compression

Capability	OmniRoute (opens in a new tab)	9Router (opens in a new tab)	LiteLLM (opens in a new tab)	CLIProxyAPI (opens in a new tab)
Built-in MCP server	110 gateway tools	No	MCP client / gateway	No
A2A protocol	Server · 6 skills	No	A2A client / gateway	No
Cloud agents	Codex / Cursor / Devin / Jules	No	No	Sidecar integrations

Capability	OmniRoute (opens in a new tab)	9Router (opens in a new tab)	LiteLLM (opens in a new tab)	CLIProxyAPI (opens in a new tab)
Failure-isolation layers	3: provider / connection / model	Cooldown	Cooldown / retry	Cooldown
Persistent memory	FTS5 + vector	No	Semantic cache	No
Guardrails	PII / injection / vision	No	Yes	Cloaking controls
Eval framework	Built in	No	No	No
TLS fingerprint controls	wreq-js	No	No	uTLS

Capability	OmniRoute (opens in a new tab)	9Router (opens in a new tab)	LiteLLM (opens in a new tab)	CLIProxyAPI (opens in a new tab)
Dashboard stack	Next.js 16	Next.js 16	Next.js	Next.js / React
UI locales	42	10	Not documented	3
OAuth providers	25	6	SSO	CLI auth
Self-hostable	Yes	Yes	Yes	Yes
License	MIT	MIT	MIT + enterprise	MIT

Public README and official documentation snapshot; verify linked sources before purchase or deployment decisions.

Inaendeshwa popote

9 supported ways to run OmniRoute.

Msingi mmoja wa msimbo, njia tisa za kuiendesha. kompyuta ya mezani, seva, simu au programu-jalizi. Chagua amri ya usakinishaji na unaendesha kwenye bandari 20128.

npm

npm install -g omnirouteOpen guide

Docker

docker run … diegosouzapw/omnirouteOpen guide

Desktop

Kompyuta ya Mezani

npm run electron:buildOpen guide

ARM

native arm64

Android · Termux

Termux

pkg install nodejs && npx -y omnirouteOpen guide

PWA

Add to Home ScreenOpen guide

OpenCode plugin

Programu-jalizi ya OpenCode

@omniroute/opencode-providerOpen guide

VS Code

Install OmniCopilotOpen guide

From source

Chanzo

npm install && npm run devOpen guide

Routing

Choose an `auto` route.

Use a ready-made mode or combine 19 strategies around the goal that matters.

Model · fallback enabledautoBalanced default

OpenAI-compatible request

curl http://localhost:20128/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model":"auto","messages":[{"role":"user","content":"Write a TypeScript retry helper."}]}'

Drain subscription quota

Use quota you already have before touching paid APIs.

priority · fill-first

Spread load

Balance traffic across keys and accounts to reduce rate-limit pressure.

weighted · round-robin · p2c · least-used · headroom

Cheapest first

Route to the lowest-cost eligible target.

cost-optimized

Context-aware

Keep long contexts on models that fit, then relay when needed.

context-relay · context-optimized · cache-optimized

Randomized

Distribute eligible traffic across targets.

random · strict-random

Adaptive scoring

Use 15-factor scoring, last-known-good and reset-aware windows.

reset-window · reset-aware · lkgp · auto · fusion · pipeline

Tokeni bure, zilizohesabiwa kwa uaminifu

~1.51B tokeni bure kwa mwezi.

455 catalog entries are deduplicated into 40 recurring pools; only published positive budgets feed the headline.

1.51B

Pool-deduped accounting keeps shared quotas from being counted more than once. No-cap providers stay visible without inflating the token total. Checked 2026-08-30.

View the calculation

Recurring or keyless free-forever providers56

Mistral1B/month
LLM7150M/month
Nara150M/month
Gemini CLI · forever60M/month
Kiro50 credits/month
Qoder · foreverFree catalog
LongCat · forever50M/day
Cerebras1M/day
NVIDIA NIM~40 RPM
Pollinations · foreverNo key
Cloudflare Workers AI · foreverDaily neurons
OpenCode Free · foreverNo-auth catalog

Acha kuchoma tokeni

Reduce eligible tokens by 15–95%.

Matokeo ya zana, muktadha unaorudiwa na JSON iliyovimba vinafinywa kabla havijafika kwa mfano. maana ile ile, sehemu ndogo ya tokeni. Injini 12 zinazochanganyika zinajengana katika mfululizo unaoudhibiti.

Before69 tokens

The function should iterate over the list of items, and for each item, it should check whether the value is greater than zero, and if so, add it to the running total.

After19 tokens

sum all list items where value > 0

Composable pipeline

Session-Dedup
Drop content already sent earlier in the session.
CCR
Archive large blocks and restore them on demand.
Lite
Apply conservative lossless cleanup.
RTK
Filter and deduplicate command and tool output.
Responses Tool Output
Compact Responses API tool payloads.
Headroom
Apply reversible tabular and structured-data compaction.
Relevance
Keep sentences most relevant to the latest query.
Caveman
Use rule-based prose condensation.
Aggressive
Apply stronger configured pruning.
LLMLingua-2
Use code-safe semantic pruning in an isolated worker.
Ultra
Combine high-savings stages with preservation guards.
OmniGlyph
Encode eligible repeated structures compactly.

Profiles

Published profile range~30%x-omniroute-compression: standard

Controls and output styles

Named profiles and active selector
Visual Compression Studio
Anthropic Context Editing
Adaptive context-budget dial
Per-request `x-omniroute-compression` header
Offline eval harness
Token-threshold auto-trigger
Terse prose
Less code (YAGNI)
Terse CJK 文言

Control precedence: request header → combo → profile → adaptive policy → default.

Tabaka 3, si ngazi 3

Shindwa katika kiwango sahihi. si kila kitu.

Funguo mbaya haipaswi kuua mtoa huduma. Modeli iliyokufa haipaswi kuua funguo. Kila kushindwa kunazuiwa kwenye upeo mdogo iwezekanavyo, ili kila kitu kingine kiendelee kutoa huduma.

model ⊂ connection ⊂ provider

Provider circuit breakerWhen a provider is unhealthy, combo routing skips it until a half-open probe succeeds.

Connection cooldownCool down one key or account while sibling connections keep serving.

Model lockoutLock one rate-limited or unavailable model while other models on the connection remain available.

Network controls

Network routing and local data controls.

Proxy scopes control network routing while local-first storage keeps operational data on your machine.

Three proxy scopes

Route globally, per provider or per individual connection.

Global · per-provider · per-connection
SOCKS5 and HTTP(S) proxies
Proxy marketplace integration

TLS and client fingerprint controls

Match supported provider clients down to selected transport characteristics.

JA3/JA4-capable transport via wreq-js
Provider-specific client profiles
IPv4 and IPv6 egress controls

Private and local-first

Keys, usage and history stay on the host you control.

SQLite on disk with AES-256-GCM encrypted credentials
No OmniRoute account required
Self-host on infrastructure you choose

RussiaChinaIranCubaTürkiye

Ona kila kitu kwa mtazamo mmoja

Dashibodi kamili, si faili ya usanidi.

Manage providers, combos, analytics, health and costs at `localhost:20128/dashboard`.

localhost:20128/dashboardExample data

352providers connected

90+free tiers available

198healthy in this example

Claude Code · OAuth · live
Cerebras · free · live
Groq · cooldown example
NVIDIA NIM · free · live

Inayofaa kwa mawakala

Unganisha wakala. anaendesha OmniRoute mwenyewe.

OmniRoute si seva ya mbadala tu. inasema itifaki za mawakala. Iunganishe kwenye mteja wa MCP, mtandao wa A2A au wakala wa uandishi msimbo wa wingu na inakuwa zana ambayo wakala anaweza kuiendesha.

Seva ya MCP

110 tools across 33 scopes over stdio and HTTP transports.

110 tools · 33 scopes · stdio / HTTP

claude mcp add omniroute --type http --url http://localhost:20128/api/mcp/stream

Seva ya A2A

6 skills for smart routing, quota, discovery, cost analysis and health reporting over JSON-RPC 2.0.

6 skills · JSON-RPC 2.0 · Agent Card

Mawakala wa Wingu

Endesha Codex, Cursor, Devin na Jules kupitia kiolesura kimoja. unda kazi, idhibiti mipango na upate matokeo kwa njia ya mto, yote yakipitishwa kupitia OmniRoute.

Codex · Cursor · Devin · Jules

Zaidi ya uelekezaji

Si seva ya mbadala tu. ni jukwaa.

Huduma zilizopachikwa

Endesha Bifrost (Go relay), 9Router au CLIProxy kama sidecars zinazosimamiwa. au profaili kamili ya nguzo. moja kwa moja kutoka dashibodi.

Maarifa yako, katika muktadha

Notion & Obsidian zimeunganishwa kama zana za MCP. madokezo na vaults zako zinakuwa muktadha wa daraja la kwanza kwa modeli yoyote.

Vizuizi vilivyojengwa ndani

Kinga dhidi ya prompt-injection kwenye kila njia, uondoaji wa PII wa hiari na usanifishaji wa kichujio cha maudhui ya usalama. ulinzi bila kufungiwa kwa muuzaji.

Gamification

Misururu, mafanikio na akiba ya moja kwa moja. matumizi yako, yaliyofanywa kuwa dhahiri.

Guides

Setup guides in three languages

Walkthroughs cover installation, free-provider setup and connecting an IDE.

Jamii inayokua kwa kasi, inayofanya kazi

OmniRoute inasafirishwa mara kwa mara. inayoendeshwa na mamia ya wachangiaji wanaohakikisha inakuwa mbele.

Public since February 13, 2026

59,579 stars

View the repository

8,274forks
583contributors
280releases shipped

Snapshot from 2026-09-01

OmniRoute by Cheaper Inference

Choose how you run OmniRoute.

Self-host OmniRoute, or start with Cheaper Inference for a hosted cost-ranked gateway.

Start with Cheaper Inference Self-host OmniRoute

Usikome Kuandika Msimbo.

OmniRouteworksevenbetterwithCheaperInference.

Endpoint moja. Usiache kujenga.

Usikutane na mipaka kamwe

Okoa hadi 95% ya tokeni

$0 kuanza

35 supported integrations

Endpoint moja

Kiwango cha uzalishaji

All behind one endpoint.

Amri tatu. Usanidi sifuri.

Step 1: Install

Step 2: Run

Step 3: Connect your tool

Kila kitu kimejengwa ndani. Bila nyongeza.

Mchanganyiko Mahiri

Kumbukumbu

3-layer resilience

Hisa Bure

Ukandamizaji

Seva ya MCP

Itifaki ya A2A

Keep your existing coding tools.

Sasa katika VS Code Copilot Chat yako

Official Marketplace

Open VSX Registry

Hakuna mpango wa Copilot unaohitajika

Kwa Nini OmniRoute

Jinsi tunavyolinganishwa

9 supported ways to run OmniRoute.

npm

Docker

Desktop

ARM

Android · Termux

PWA

OpenCode plugin

VS Code

From source

Choose an `auto` route.

Drain subscription quota

Spread load

Cheapest first

Context-aware

Randomized

Adaptive scoring

~1.51B tokeni bure kwa mwezi.

Reduce eligible tokens by 15–95%.

Composable pipeline

Profiles

Controls and output styles

Shindwa katika kiwango sahihi. si kila kitu.

Network routing and local data controls.

Three proxy scopes

TLS and client fingerprint controls

Private and local-first

Dashibodi kamili, si faili ya usanidi.

Unganisha wakala. anaendesha OmniRoute mwenyewe.

Seva ya MCP

Seva ya A2A

Mawakala wa Wingu

Si seva ya mbadala tu. ni jukwaa.

Huduma zilizopachikwa

Maarifa yako, katika muktadha

Vizuizi vilivyojengwa ndani

Gamification

Setup guides in three languages

🇧🇷 Complete guide · Português

🇺🇸 Complete guide · English

🇷🇺 Complete guide · Русский

Jamii inayokua kwa kasi, inayofanya kazi

Public since February 13, 2026

Discord

Telegram

WhatsApp 🌍

WhatsApp 🇧🇷

Choose how you run OmniRoute.