On this page
All automation tools
Portkey: artificial intelligence features and setup
A gateway and production infrastructure for enterprise Gen AI: routing, management, and control.
Tool by the Otomatzia editorial team · source content checked on
Overview
Portkey serves as a gateway to model providers when an organization wants routing, control, and management instead of direct calls from every service. You can set routes, limits, and usage tracking. This is relevant when several teams call models and need a single policy. Before deployment, map which applications will go through the gateway and what happens when a provider is unavailable.
Features
- A gateway for enterprise Gen AI calls
- Routing between providers and usage policies
- Control and tracking of production runs
Business uses
- Routing several internal applications through one model gateway
- Switching to an alternative provider when the primary provider is unavailable
Getting started
- Connect one provider's test key through the gateway.
- Configure a simple routing rule and test a provider failure.
- Check which data is recorded in the log before connecting production.
What to check
- Make sure the gateway does not become a point of failure without a fallback route.
- Check team permissions before sharing keys through the gateway.
Sources to check next
Vendor features and prices change. Confirm details on the linked official pages before you rely on them.