tools
Portkey AI Gateway
Portkey AI Gateway routes, monitors, secures, and governs requests across multiple AI model providers through one API.
Portkey AI Gateway gives developers and AI platform teams a unified API for connecting to language, vision, audio, and image models. It provides routing, fallbacks, retries, load balancing, caching, key management, observability, prompt management, and guardrails.
Teams use it to operate AI applications in production across multiple providers. The hosted service has Free Forever, Production, and Enterprise plans; enterprise features include custom retention, private-cloud deployment, SSO, and advanced compliance. The gateway is also available as open-source software for self-hosting.
Features
- Unified API for connecting to multiple AI models and providers
- Automatic fallbacks, retries, load balancing, and conditional routing
- Request logs, traces, metadata, filters, alerts, and usage analytics
- Simple and semantic caching for reducing latency and model costs
- Virtual keys, provider key management, role-based access control, and budgets
- Prompt templates, playground, versioning, variables, and API deployment
- Open-source AI Gateway under the MIT license
Use cases
- Route production requests across multiple LLM providers
- Recover from provider outages with fallbacks and automatic retries
- Track model usage, latency, errors, and costs across teams
- Control access to models with keys, roles, budgets, and rate limits
- Test and deploy versioned prompts across different models
- Self-host an AI gateway for internal or regulated workloads
Pros
Cons
Pricing
- Starting price
- $49/month
- Pricing checked
- 2026-09-19
Developer
Free Forever
- 10k recorded logs per month
- 3-day log retention and 30-day metrics retention
- Universal API, fallbacks, load balancing, and retries
- Logs, traces, feedback, custom metadata, and filters
- 3 prompt templates and community support
Production
$49/month
- 100k recorded logs per month
- +$9 overages per additional 100k requests
- 30-day log retention and 90-day metrics retention
- LLM and partner guardrails
- Unlimited prompt templates
- Role-based access control and service account API keys
- Production support
Enterprise
Custom Pricing
- 10 Mn Plus recorded logs per month
- Custom retention periods for logs and metrics
- Custom guardrail hooks and advanced evaluation templates
- SSO, granular budgets, and rate limits
- Private cloud deployment and VPC hosting
- SOC2 Type 2, GDPR, HIPAA, and custom BAAs