Features
Detailed documentation for each LLM Gateway capability - Routing, Token Saving, Guardrails, Prompt Store, Identity Aware, and more.
Request Routing
Multi-provider load balancing and failover behind a single API key.
Token Saving
Reduce token usage by compressing input content automatically.
Security Guardrails
Detect and act on sensitive data and adversarial inputs.
Custom Intents
Define your own detection categories with examples.
Rate Limits
Control request rates, token budgets, and key expiry.
Prompt Store
Manage and version system prompts centrally.
Red Team Testing
Test your guardrails configuration against adversarial prompts.
Identity Aware
Authenticate and track users behind each API key.