Cost-optimizing AssemblyAI speech-to-text inference on AWS with Amazon EC2 Spot

AssemblyAI runs GPU-based speech-to-text inference on Amazon ECS using a mix of EC2 Spot and On-Demand Instances across g4dn, g5, and g6 GPU families, with an Amazon SQS-based retry mechanism that returns in-flight jobs to the queue when a Spot Instance receives a 2-minute interruption notice. The architecture is deployed independently in us-west-2 and eu-west-2 for data residency, and AssemblyAI reports 70 percent cost savings on inference compute compared to On-Demand pricing while maintaining SLA commitments.