Google adds daily token quotas to control BigQuery generative AI function costs
Overview
Google Cloud says BigQuery's generative AI functions, including AI.GENERATE, AI.IF, AI.CLASSIFY, AI.SCORE and AI.AGG, now have daily token quotas that administrators can set in the Google Cloud console.
Four global project-level quotas cover input and output tokens, with per-user limits, and default to 200 billion input and 20 billion output tokens per day per project.
Embedding functions such as AI.EMBED and AI.GENERATE_EMBEDDING are excluded because Google says they run on different, substantially cheaper models. To tighten cost control, administrators lower a quota. Google says many requests are auto-approved, and larger increases may go through a quick review.
Written by AI from the articles below · updated Oct 14, 12:42 PM ET
Check the sources:
Article timeline
The articles in this story. Times are ET.
- Google Cloud · AI & Machine LearningOfficialBigQuery adds daily token quotas to cap generative AI function spending
AIGoogle Cloud says BigQuery's generative AI functions, including AI.GENERATE, AI.IF, AI.CLASSIFY, AI.SCORE, and AI.AGG, now have daily token quotas that administrators can set in the Google Cloud console. Four global project-level quotas cover input and output tokens, with per-user limits, and default values of 200 billion input and 20 billion output tokens per day per project. Embedding functions such as AI.EMBED are excluded from the quotas.
Heat trend
Not enough continuous observations to show a trend yet.