Market AI Tools Resilient LLM Router
Resilient LLM Router
A multi-provider LLM client with automatic failover and one consistent JSON schema across Groq, Gemini, OpenAI, and Anthropic — powered by your own keys.
Live demo coming soon

Resilient LLM Router

A multi-provider LLM client with automatic failover and one consistent JSON schema across Groq, Gemini, OpenAI, and Anthropic — powered by your own keys.

4
Providers Supported
1
Unified Interface
BYOK
Your Keys, Your Costs
0
Monthly Fees to Us

Why This Exists

Every LLM provider speaks a slightly different dialect — different request bodies, different response envelopes, different failure modes. This router wraps Groq, Gemini, OpenAI, and Anthropic behind one interface. You define an ordered chain of providers; a call goes to the first one, and if it errors, times out, or is rate-limited, the router falls through to the next provider automatically. Every response is translated into a single JSON schema, so your application code never branches on which provider answered. It is reactive failover — the router does not predict or pre-empt a provider going down; it retries down the chain when a call actually fails.

Features

Automatic Failover

On error or timeout, the request falls through to the next provider in your chain

One JSON Schema

Every provider is normalized to a single, predictable response shape

Ordered Provider Chain

Configure free-first, cheap-first, or quality-first — your call

Bring Your Own Keys

Your provider keys, your costs, zero markup from us

What You Get

Full source code — yours to modify, extend, and deploy
Provider adapters for Groq, Gemini, OpenAI, and Anthropic
Ordered fallback chain with configurable per-provider timeout and retry
JSON-schema translation layer that normalizes every provider response
BYOK configuration — one .env entry per provider key
A provider whose key is empty is skipped silently, so partial setups still work
Framework-specific packaging for your chosen version
Installation guide and documentation

How It Works

1

Configure Your Chain

List the providers you want, in the order you want them tried. A common setup is free-first (Groq → Gemini) then paid (OpenAI → Anthropic). Each provider reads its own key from your environment.

2

Send One Request

Your application calls the router with a prompt (and optionally a JSON schema for structured output). It does not need to know or care which provider will answer.

3

Automatic Failover

The router calls the first provider. If that call errors, times out, or returns a rate-limit response, it moves to the next provider in the chain and tries again — until one succeeds or the chain is exhausted.

4

Consistent Response

Whichever provider answered, the result is translated into one JSON schema before it reaches your code. Text and structured output come back in the same shape every time.

Technical Details

Provider Adapters

One adapter per provider (Groq, Gemini, OpenAI, Anthropic), each mapping the router request to that provider REST API and its response back to the shared schema.

Fallback Chain

An ordered list you configure. Failover is reactive: the next provider is tried only when the current call fails (error, timeout, or rate-limit response).

JSON Schema Translation

A normalization layer converts each provider response into one predictable JSON shape, including structured / JSON-mode output where the provider supports it.

Error Handling

Per-provider timeout and retry settings. Exhausting the chain raises a single, typed exception rather than leaking a provider-specific error.

Bring Your Own Keys

Each provider key lives in your environment. Requests go directly from your server to the provider. We never see your keys, prompts, or usage.

Packaging

Choose Laravel (service class + config + facade) or Vanilla PHP (PSR-4, Composer-installable) at checkout. Same adapters and fallback logic in both.

Real Results

From our own production deployment — the same code you are buying.

We run this fallback chain across our own apps — the same code you are buying
When our free Groq tier hits its per-minute token limit, requests fall through to the next configured provider automatically, with no manual intervention
One JSON schema across four providers means application code never branches on which model answered
Adding a provider is one adapter against a shared interface — no changes to calling code
Zero vendor lock-in — reorder or swap providers by editing configuration, not application logic

Frequently Asked Questions

No. It does not predict provider health or pre-empt a rate limit. It reacts: when a call fails — including a rate-limit response — it falls through to the next provider in your chain. That is the honest behavior, and it is what keeps a request from dying when one provider is having a bad minute.
Groq, Gemini, OpenAI, and Anthropic out of the box, each with its own adapter. Because adapters are isolated, adding another provider means writing one adapter against the shared interface.
You register your own keys with each provider and put them in your environment. All requests go directly from your server to the providers. We never see your keys, your prompts, or your usage, and you pay each provider directly at their rates.
That is fine. A provider whose key is empty is skipped silently, so a chain works with whatever keys your server actually has. You can start with one and add more later.
Every provider is normalized to one JSON schema before the result reaches your code, so you never branch on which provider answered. Structured / JSON-mode output is supported where the underlying provider supports it.
Choose Laravel for a drop-in package with a service class, config file, and facade. Choose Vanilla PHP for a framework-agnostic, Composer-installable library. Both ship the same provider adapters and fallback logic.
Email support for installation and configuration, bug fixes for confirmed bugs in our code, and minor updates during the support period. It does not cover customization, new provider adapters, or support for modified code.
Regular covers one site or project you or your client own. Extended covers one SaaS or commercial product where end users are charged. See the license terms on the product page.
$ one-time

Laravel package with a service class, config file, ordered provider chain, and a facade. Drop your keys in .env and resolve the router from the container.

Laravel 10+ / PHP 8.1+

Framework-agnostic PHP library (PSR-4, Composer-installable) with the same provider adapters and fallback logic, no framework required.

PHP 8.1+ with a PSR-18 HTTP client (Guzzle included)

This product isn't available for purchase yet.

Item Details

Category AI Tools
Released Sep 16, 2026
Last Updated Sep 16, 2026
Compatible With
PHP 8.1+ Laravel 10+ Any PHP 8.1+ project
Tags
ai llm openai anthropic gemini groq failover json-schema byok
Blorp Blorp
Software Studio

We build the tools we sell. Every product is extracted from our own production systems.

Book a call for custom work

More from Blorp Blorp Market

AI-Powered

AI Contact Form

An intelligent contact form that qualifies leads, blocks spam, and drafts responses — powered by your own OpenAI key.

$499 View →
Multi-Tenant

Creator Affiliate Storefronts

A multi-tenant, keyed Amazon affiliate platform — your site earns on the house tag while each approved creator earns on their own. Drop-in Laravel, bring your own Associates tags.

$149 View →
AI-Powered

Embeddable AI Chatbot Widget

A one-script embeddable AI chat widget with a bring-your-own-key Laravel backend. Your OpenAI/Anthropic key stays on your server.

$39 View →
AI-Powered

AI Citation Verifier

Submit claims with the source URLs that back them; each source is fetched behind an SSRF guard and graded by an LLM as Supports / Partially / Contradicts / Irrelevant. Bring your own key.

$69 View →
Self-Hosted

Document e-Sign Kit

A self-hosted e-signature core for Laravel: per-signer magic-link click-to-sign plus a hash-chained, tamper-evident audit trail you can re-verify. No third-party provider.

$59 View →
Developer Tool

Project Scope Estimator

A deterministic, multi-step project scope + price/time estimator with optional lead capture. Ships as both a Laravel package and a self-contained vanilla-JS widget. No AI required.

$29 View →
AI Tools

LLMO / llms.txt Kit

Generate a correct llms.txt and AI-crawler robots groups for your site, plus a heuristic LLM-readiness report. SSRF-guarded, bring-your-own-key optional copywriting.

$39 View →
Novelty

Playful Bot-Gate

A friendly mini-game human check for your forms — the answer is verified server-side and a single-use signed token gates the submit. A novelty/engagement gate, not a security wall.

$29 View →
Developer Tool

Brand Palette + WCAG Contrast Utility

A pure-PHP utility that computes WCAG contrast ratios from your brand colors and tells you which pairings pass AA / AAA — with accessible pairing suggestions. No AI, no network.

$29 View →
Developer Tool

Styled QR Generator

A stateless engine that renders branded SVG QR codes — module styles, frames, gradients, and an embedded logo — with pluggable payload encoders (url / wifi / vcard / geo / text).

$49 View →
Developer Tool

Occupancy / Capacity Counter

A concurrency-safe, append-only manual headcount ledger — lock-safe in/out events, zero-clamped, that warns then flags when a configurable capacity is exceeded. Counts people without identifying them.

$49 View →
Developer Tool

Credential Expiry Roster

A roster report that buckets worker credentials into EXPIRED / EXPIRING-SOON / UNDATED (an undated credential is a gap, not "fine"). Records operator attestation — it does not verify credentials against any issuer.

$99 View →
Developer Tool

Laravel Calculator Suite

A headless pack of 27 real, working calculators (financial, health, home, utility) behind one BaseCalculator contract, a pure-PHP registry, and a sanitized /calculate JSON endpoint. Estimates only — every one ships a disclaimer.

$79 View →

Need This Customized?

We built this product. We can customize it for your specific needs, integrate it with your systems, or build something entirely new.