AWS describes how to set up OpenAI ChatGPT Codex with a LiteLLM gateway running on Amazon ECS using AWS Fargate. The gateway, operated by the customer, connects to an OpenAI model available through Amazon Bedrock. Codex is configured to route its requests through the gateway’s Responses API, with controls including scoped identities, budgets, rate limits, and telemetry. The post also compares alternative approaches: direct access via IAM Identity Center and a managed Portkey deployment.
Who should care
Developers and engineering teams working within AWS environments who want to route Codex traffic through a managed gateway with identity, budget, and rate-limit controls will find this setup relevant, along with those evaluating gateway options such as LiteLLM versus Portkey.