Building a self-service LLM gateway with Amazon Bedrock and LiteLLM

A self-service LLM gateway built on Amazon Bedrock Application Inference Profiles and LiteLLM running on AWS Fargate exposes Bedrock foundation models behind an OpenAI-compatible API, giving developers a single base URL and per-user key. The setup adds per-user spend controls, per-model quota isolation, and CloudWatch RPM/TPM observability, with Langfuse for prompt-level telemetry. Self-service key issuance requires LiteLLM Enterprise, since the free tier is limited to five users.