Routiform

# Routiform

One AI endpoint for your apps, tools, and agents.

Routiform is a self-hosted AI gateway and dashboard for teams that want one stable integration point across 60+ providers. You send OpenAI-compatible requests to one `/v1/*` endpoint, and Routiform handles translation, routing, retries, fallback, and operations.

It is built for developers who want to:

- integrate once, then swap providers and models without rewriting client code
- keep Cursor, Cline, Claude Desktop, Codex, MCP clients, and internal apps on one base URL
- survive provider outages, model deprecations, and quota limits with policy-driven fallback
- reduce cost using combo routing, budget guards, and lower-cost model paths
- run their own gateway with full visibility into keys, logs, quotas, and health

## Why teams choose Routiform

- **One API surface**: OpenAI-compatible routes for chat, embeddings, images, audio, video, rerank, search, and more
- **Resilience by default**: retries, multi-account failover, model-family fallback, and emergency fallback
- **Cost-aware routing**: weighted/priority/P2C strategies, budget controls, and quota-aware decisions
- **Built for agents**: MCP server (25 tools), A2A v0.3 support, memory, and skills
- **Operational control**: dashboard for providers, combos, keys, usage, logs, and endpoint health

<div align="center">

[![npm version](https://img.shields.io/npm/v/routiform?color=cb3837&logo=npm)](https://www.npmjs.com/package/routiform)
[![Docker Hub](https://img.shields.io/docker/v/linhnguyen0944/routiform?label=Docker%20Hub&logo=docker&color=2496ED)](https://hub.docker.com/r/linhnguyen0944/routiform)
[![npm downloads](https://img.shields.io/npm/dm/routiform?label=npm%20downloads&color=red)](https://www.npmjs.com/package/routiform)
[![Docker pulls](https://img.shields.io/docker/pulls/linhnguyen0944/routiform)](https://hub.docker.com/r/linhnguyen0944/routiform)
[![GitHub stars](https://custom-icon-badges.demolab.com/github/stars/linhnguyen-gt/Routiform?logo=star&style=flat)](https://github.com/linhnguyen-gt/Routiform/stargazers)
[![MIT License](https://img.shields.io/badge/license-MIT-green.svg)](LICENSE)

</div>

## Product demo

![Routiform dashboard overview](docs/screenshots/MainRoutiform.png)

### Feature demos

| Endpoint workspace                                      | Combo routing builder                               |
| ------------------------------------------------------- | --------------------------------------------------- |
| ![Endpoint dashboard](docs/screenshots/09-endpoint.png) | ![Combos dashboard](docs/screenshots/02-combos.png) |

| Settings and operational controls                       |
| ------------------------------------------------------- |
| ![Settings dashboard](docs/screenshots/06-settings.png) |

These screens show the day-to-day workflow: manage unified endpoints, configure routing combos with fallback policies, and control operational settings from one dashboard.

## Core capabilities

### Unified API gateway

- OpenAI-compatible API surface for chat, embeddings, images, audio, video, rerank, search, and more
- Request and response translation across OpenAI, Anthropic, Gemini, and provider-specific formats
- Works with local apps, server deployments, CLI tools, browser clients, and agent frameworks

### 60+ providers

Routiform supports a broad provider mix, including:

- OpenAI
- Anthropic
- Google Gemini
- DeepSeek
- Groq
- xAI
- Mistral
- Fireworks
- Cohere
- NVIDIA
- Cerebras
- OpenRouter
- Hugging Face
- Cloudflare AI
- Ollama Cloud
- Together
- Perplexity
- Tavily
- Brave
- Exa
- and many more

Provider types include:

- free providers
- OAuth-backed providers
- API-key providers
- custom OpenAI-compatible providers
- custom Anthropic-compatible providers

### Routing and resilience

- combo-based routing across multiple models/accounts/providers
- weighted, priority, round-robin, P2C, and cost-aware strategies
- model-family fallback and emergency fallback
- multi-account failover inside the same provider
- retry handling and resilience profiles
- rate-limit aware behavior and quota checks
- circuit-breaker style protections for unstable upstreams

### Cost and quota controls

- budget-aware routing controls
- quota snapshots and health checks
- cost reporting endpoints and dashboard views
- low-cost and free-tier friendly setups
- policy-driven model selection for operational or cost goals

### Built-in protocols for agent workflows

- MCP server with 25 tools and multiple transports
- A2A v0.3 support with task lifecycle handling
- memory tools for search/add/clear
- skills system for extensible agent behaviors

### Dashboard and operations

- provider connection management
- model catalog and per-provider model sync
- combo editor and routing strategies
- request logs and detailed logs
- API key manager and scoped access controls
- endpoint health and metrics
- webhook and automation surfaces

## Supported API surfaces

Routiform exposes a unifi

... (truncated)