Amazon adds usage-based metering for SageMaker AI bidirectional streaming
AIAmazon announces usage-based metering for Amazon SageMaker AI bidirectional streaming inference, so model providers can report actual usage for the AWS Marketplace software charge. Metering runs over a companion WebSocket, with each record reporting ConsumedUnits under the inference.count dimension, and endpoint infrastructure charges still apply.
Source details
AWS Machine Learning Blog · Victor Wang · aws.amazon.comPublished · added here
Original title: Introducing usage-based pricing for Amazon SageMaker AI bidirectional streaming