Amazon adds usage-based metering for SageMaker AI bidirectional streaming inference
Overview
Amazon announces usage-based metering for Amazon SageMaker AI bidirectional streaming inference, so model providers can report actual usage for the AWS Marketplace software charge.
Metering runs over a companion WebSocket, with each record reporting ConsumedUnits under the inference.count dimension. Amazon SageMaker AI endpoint infrastructure charges still apply. The metadata stream has a rate quota of one message per second per connection, with a maximum message size of 512 bytes.
Deepgram is the launch partner, bringing usage-based Speech-to-Text and Text-to-Speech billing to AWS Marketplace. Model providers choose hourly or per-inference pricing when they create a listing, because a released listing cannot be switched between the two.
Written by AI from the articles below · updated Nov 11, 10:21 AM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- AWS Machine Learning BlogOfficialAmazon adds usage-based metering for SageMaker AI bidirectional streaming
AIAmazon announces usage-based metering for Amazon SageMaker AI bidirectional streaming inference, so model providers can report actual usage for the AWS Marketplace software charge. Metering runs over a companion WebSocket, with each record reporting ConsumedUnits under the inference.count dimension, and endpoint infrastructure charges still apply. Deepgram is the launch partner, bringing usage-based Speech-to-Text and Text-to-Speech billing to AWS Marketplace.
Heat Trend
- Current comparable heat
- 6
- Peak comparable heat
- 10Nov 11, 11:00 AM ET
- Change in past 24 hours
- –
The trend compares only continuously observed participants, so its scope may be smaller than the current heat total. Hover or tap for hourly heat; use arrow keys with a keyboard.