[ROUTING]

Never go down because your provider did.

Store your LLM provider keys in Grepture. The proxy automatically fails over between keys and across providers on auth errors, rate limits, timeouts, and server errors — with cross-provider request translation built in.

[What it does]

Grepture manages your LLM provider API keys and uses them to route requests. Configure multiple keys per provider and cross-provider fallback paths. The proxy detects authentication errors, rate limits, timeouts, and server errors — and automatically retries with the next key or provider. Cross-provider fallback translates the request and response format automatically, so your application code never changes.

[How it works]

Add provider keys in the Grepture dashboard. Set a primary key per provider and link fallback keys — same-provider or cross-provider. The proxy handles key selection, error detection (401, 408, 429, 5xx), and format translation between providers. Every fallback attempt is traced in the dashboard. Combine with zero-data mode for full protection without storing request content.

app.grepture.com/settings/provider-keys
[PROVIDER KEYS]
ProviderNameKeyDefault modelStatus
OpenAIprod-openai-1...a3f2gpt-4oprimary
OpenAIprod-openai-2...7d9egpt-4ofallback
Anthropicprod-anthropic...k4m1claude-sonnet-4-20250514primary
Fallback chain
prod-openai-1prod-openai-2prod-anthropic(cross-provider)
[FALLBACK TRACE]req_8f3a2b · 2 retries · resolved via cross-provider
429POST /v1/chat/completionsOpenAI(prod-openai-1)12msrate_limited
503POST /v1/chat/completionsOpenAI(prod-openai-2)8msserver_error
200POST /v1/messagesAnthropic(prod-anthropic)847ms
[Key features]
  • +Store and manage API keys for OpenAI, Anthropic, Gemini, and Azure
  • +Same-provider fallback — rotate through multiple keys on errors
  • +Cross-provider fallback — fail over from OpenAI to Anthropic or any combination
  • +Automatic request/response translation between provider formats
  • +Triggers on 401, 408, 429, and 5xx errors — skips 400s (that's your bug)
  • +Full trace visibility — see every fallback attempt in the dashboard
  • +Zero-data mode compatible — fallback works without storing request content
  • +Combine with PII redaction, evals, and cost tracking on the same hot path

See your first trace in under 60 seconds

npm install @grepture/sdk — wrap your client — done.

Free for up to 1,000 requests/month · No credit card required

Get Started Free