AWS Machine Learning Blog· Belair Albahagwi·· 2 h agoAI score30
AssemblyAI uses Amazon EC2 Spot Instances to cost-optimize speech-to-text inference on AWS
Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot
AI summary
AssemblyAI runs its GPU-heavy speech-to-text inference on Amazon ECS with a mix of EC2 Spot and On-Demand Instances, spanning g4dn, g5, and g6 GPU families across US West (Oregon) and Europe (London). An Amazon SQS-based retry mechanism returns interrupted jobs to the queue via an EventBridge-triggered Lambda handler, preserving SLA commitments while cutting costs.
Source:AWS Machine Learning Blog · aws.amazon.com