ServiceTiers

Specifies the service tier to use for the completion request.

Remarks

The ServiceTiers enumeration allows you to select the quality-of-service level for the LLM request. Service tiers can affect response speed, reliability, and cost, and may be used to prioritize certain requests or manage resource allocation.

Usage Guidance

• Use auto to let the API select the most appropriate tier based on current load and request parameters.
• Use default for standard service, balancing cost and performance.
• Use flex for cost-optimized, lower-priority requests that can tolerate longer wait times.
• Use priority for high-priority requests that require the fastest possible response, potentially at higher cost.

Impact

Selecting a higher service tier may improve response time and reliability, but can increase usage costs. Not all models or accounts may support all tiers; see the OpenAI API documentation for details.

Can be one of the following values:

Used By

Chat Parameters