Understanding 'openai.assistants.default' rate limits in Azure OpenAI

Ana Carolina Candian Lobato 0 Reputation points
2025-01-13T19:01:42.6233333+00:00

I noticed in my Azure OpenAI metrics dashboard that there are two distinct rate limit keys beyond my model deployments: 'openai.assistants.default' and 'openAi'. I would like to know what 'openai.assistants.default'/'openai' specifically measures and what are the rate limits associated with it. Are there separate quotas/limits for Assistant API operations that differ from the standard deployment rate limits?openai-assistants-default

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,513 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. Pavankumar Purilla 2,290 Reputation points Microsoft Vendor
    2025-01-13T22:03:32.9+00:00

    Hi Ana Carolina Candian Lobato,
    Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!
    The rate limits you are seeing, 'openai.assistants.default' and 'openai', are related to different aspects of Azure OpenAI's usage and quota management.
    openai.assistants.default: This rate limit key typically measures the usage and quota for the Assistant API operations. These operations are specific to the Azure OpenAI Assistant, which might include tasks like generating responses, handling conversations, and other assistant-related functionalities. The rate limits for these operations can be different from the standard deployment rate limits, as they are tailored to the specific needs and usage patterns of the Assistant API.

    openai: This rate limit key generally measures the overall usage and quota for the Azure OpenAI service. It encompasses all the operations and requests made to the Azure OpenAI endpoints, including model deployments, API calls, and other related activities. The rate limits associated with this key are more comprehensive and cover a broader range of operations compared to the 'openai.assistants.default' key.

    Hope this helps. Do let us know if you have any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful.


Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.