Engineered for Production Scale
Eliminate developer LLM friction and lock in margins at runtime with our comprehensive feature set.
Intelligent Routing
Task classification shifts payloads dynamically to default or fallback models to guarantee cost compliance and a constant ≥40% margin floor.
- Weighted scoring algorithm considers quality, cost, latency, reliability, and context match
- Automatic fallback chain with max 2 retries on provider failure
- Circuit breaker monitors upstream reliability in real-time
- Configurable margin floor enforcement per customer tier
Subscription Credits
Transactional billing-cycle credit reservations use the resolved model's base credit cost and protect one shared subscription pool across API keys.
- Monthly and yearly periods follow actual subscription renewal dates
- Plan credits are consumed before non-expiring prepaid credits
- Failed provider attempts release reservations without charging credits
- Token counts remain telemetry for routing and diagnostics, not quota units
Stateless Failover
Database-backed circuit breakers monitor upstream model reliability in real-time, safely routing around downed providers.
- Persistent circuit state across container restarts
- Automatic recovery after configurable cooldown period
- Per-provider error rate tracking with graduated response
- Graceful degradation to fallback model chain
API Key Management
Granular API key controls with permissions, IP restrictions, referrer validation, and automatic expiry.
- Create and revoke keys with descriptive names
- Per-key permission scoping for fine-grained access control
- IP allowlisting and referrer origin validation
- Automatic key expiry with configurable TTL
Usage Analytics
Real-time telemetry on token consumption, model distribution, latency metrics, and cost margin tracking.
- Per-request token accounting with prompt/completion breakdown
- Model distribution charts showing usage patterns
- Latency tracking with P50 and P95 percentiles
- Gross margin monitoring per customer and per route
Team Workspaces
Organization management with role-based access control, shared subscription credits, and full audit logging.
- Multi-member organizations with Owner, Admin, and Member roles
- Shared subscription credit pools with per-key attribution
- Complete audit trail of all team actions
- Member invitation workflow with role assignment