AWS Machine Learning Blog· Victor Wang·· 3 days agoAI score26
Introducing usage-based pricing for Amazon SageMaker AI bidirectional streaming
Introducing usage-based pricing for Amazon SageMaker AI bidirectional streaming
AI summary
AWS announced usage-based metering for Amazon SageMaker AI bidirectional streaming inference, letting model providers report actual usage for AWS Marketplace software charges via a companion WebSocket metadata connection, while SageMaker AI endpoint infrastructure charges still apply. Deepgram is the launch partner, bringing usage-based Speech-to-Text and Text-to-Speech billing to AWS Marketplace. Model servers opt in with the X-Amzn-SageMaker-Metadata-Stream-Supported header and send JSON metering records with the inference.count dimension and ConsumedUnits.
Source: AWS Machine Learning Blog · aws.amazon.com