Prism is a self-hosted adaptive AI gateway. Connect supported AI providers once — paid APIs, subscription accounts and local models — and give every app and agent one OpenAI-compatible API with policy-based LLM routing, bounded failover, budgets and per-request cost accounting.
Connect provider presets, an embedded catalog of OpenAI-compatible providers, subscription accounts, local runtimes and self-hosted model servers — and route across all of them from one address.
Preset and catalog marks shown; the catalog has 165+ OpenAI-compatible providers.
Your agents and apps call one API. Prism picks the model, provider and account for each request. The request can go to a paid API, to one of your subscription accounts or to a model on your own hardware.
capability, health, quota, funds, cost
Point your applications and agents at your Prism address. They keep sending requests in the API format they already use. Your policy determines which routes are eligible, and Prism chooses among them using live signals. Agents keep their own work loop, goals, tools and workspace; Prism is the gateway they call.
curl https://[your-prism-host]/v1/chat/completions \
-H "Authorization: Bearer $PRISM_KEY" \
-d '{
"model": "auto",
"messages": [{"role": "user", "content": "Hello"}]
}'Instead of a model name, put one of these five keywords in the request's model field. Prism calls them selectors. Each one sets the order in which Prism tries the models that can serve the request.
autoTries the strongest cloud model firstApplies when the model field is auto or empty. Strength is the model's Epoch Capabilities Index. Between two equally strong models, the cheaper one is tried first. Local models are tried last.fastTries the model with the lowest latency firstPrism uses the latency it has measured on its own requests to each model. Between equally fast models, the cheaper one is tried first.smartTries the highest quality tier firstThe model catalog has four quality tiers: frontier, strong, good and baseline. Within a tier, the model with the highest Epoch Capabilities Index is tried first. Between two equally strong models, the cheaper one is tried first.cheapTries local models first, then the cheapest cloud modelFor work where cost matters more than answer quality.localUses local models onlyThe request is never sent to a cloud provider. A default strategy, a budget rule or failover cannot change that.auto.Prism records the cost and tokens of every request and totals them by app, client program, agent, person and model. It shows metered API spend separately from what your subscription traffic would have cost at API prices.
Last 30 days. Subscription value is what subscription traffic would cost at API prices; plan prices are what the subscriptions cost per month.
Every request from your agents to a model provider passes through Prism, which decides where to send it. We measured three things: how much time Prism adds to a response, how many requests and open streams an ordinary 4 vCPU machine handles, and how much memory Prism uses.
Measured on 16 October 2026 on 4 logical cores of an Intel Core i5-13500 with NVMe storage, with one provider and one model; the host was shared with other work. The provider answers instantly, so the numbers show only Prism's own overhead. The figures apply to Prism v0.44.0 and later. Other hardware and disks will give different numbers.
How we measuredPoint any coding agent, script or IDE assistant at Prism if it accepts a custom OpenAI-compatible or Anthropic endpoint. You configure your providers once, in Prism, not in every tool. With your API keys, Codex can use Claude, Gemini and other models, and Claude Code keeps its web search.
one API · selectors · keys per agentEnter Prism's address in the Ollama URL field of Open WebUI, Zed, Continue, Home Assistant or a similar app, and the app can use every model Prism routes to, cloud and local. The console's quick start shows the address to use. If the app has no field for a key, you can put your Prism key in the address (with Prism Teams, a key is required).
Ollama API · main address · any modelConnect subscription accounts through OAuth sign-in and route through them alongside API keys. Prism picks the account per request. When an account returns an error, is rate-limited or has used up its quota, Prism sends the request to the next eligible account. Sign-in to Claude, Gemini, Cursor and Grok CLI subscriptions is closed by default.
OAuth sign-in · per-request choice · failoverSend routine requests with local, and they stay on your own machines. Send hard requests with auto, and Prism picks the strongest cloud model.
Your application calls one API. Prism connects to the providers, moves a failed request to another provider or account and records the cost of each request.
one API · routing · operational controlsPrism starts the model server on your own GPU machine or a cloud GPU machine when a request needs that model, and stops it after the idle time you set.
The Add machine wizard on the console's Compute providers page adds the server Prism runs on (often with no command at all), another Linux machine (with one command) or a new cloud instance, which connects itself when you paste the text the wizard shows into its user data. Existing machines in a Nebius account or another cloud account are added on the same page. Prism finds llama-server, vLLM, Ollama and SGLang servers automatically, including ones that run as system services. Tick the ones Prism should manage. Prism does nothing on the machine until you confirm, and you do not need to edit a config file or restart Prism.
A request for a model waits while its server starts and is answered by that model once it is ready. An existing cloud machine is powered on for the request and powered off after the idle time you set. Support for Nebius is built in; Amazon EC2, Google Compute Engine, Microsoft Azure, Oracle Cloud, Alibaba Cloud ECS, Scaleway, Crusoe, Hyperstack, Paperspace and Oblivus are added with plugin packages. A machine on your own network is powered on with Wake-on-LAN and powered off through its own agent. Prism never powers a machine off while other processes are using its GPU. Prism never creates, resizes or deletes machines.
The console shows GPU load, memory, temperature, power, cost and idle time for every machine, with history charts. Usage history shows GPU machine cost next to API spend; an opt-in monthly machine budget notifies you at 80% and 100% and does not power machines off. Machines that need attention are listed first, and the page works on a phone too. Prism alerts you when GPU memory fills up, a GPU gets too hot, a powered-on machine is idle or a machine stops responding.
Give an agent a scoped key and it can start and stop model servers and power machines on and off through Prism, without SSH. That key cannot call models and gives no access to provider keys, users or the subscription.
Managed inference is part of Prism Pro and the editions above it. Connecting to model servers that are already running is included in Prism Free.
Prism runs on Linux and macOS. You control its configuration and operational data. Requests that Prism forwards to a provider are processed under that provider's own terms.
provider::model, or use a selector: auto, fast, smart, cheap, localauto gives each request a quality floor, set higher for agent steps that use tools, and sends it to the strongest model at or above it, with price deciding only between equals; cheap tries an eligible local model first, then the cheapest; smart ranks by quality, fast by latencyauto picks a model that is available through several routes, Prism tries them in the order you chooselocal selector uses local models only, and cheap tries them first. A request marked private is never sent to a cloud providerauto uses another model in place of one that has reached its limitFree: up to 3 peoplePro, Teams, Enterprise: from €4 per user / month, before tax (coming soon)
See pricingSelf-host it, connect your providers and point your agents at one API. Prism Free costs nothing, for any use.