Skip to main content

AI Gateway

AI Gateway lets teams deploy trained models as REST API endpoints. It supports both models hosted inside the tenant cluster and external model providers.

Services Behind This Feature

ServiceRole
BFF APIProxies requests and handles token exchange to the gateway backend.
AI Gateway BackendManages endpoint configuration, routing, and serving. Runs inside the tenant cluster.

Go Deeper