Grooper Help - Version 25.0
25.0.0017 2,127
  • Overview
  • Help Status

Azure Provider

LLM Provider Grooper.GPT

Defines a connection to one or more Azure LLM service deployments.

Remarks

The AzureProvider class enables Grooper to connect to Azure-hosted large language model (LLM) services, such as Azure OpenAI.

Overview

This provider allows you to configure and manage multiple Service Deployments created in the Azure portal. Each deployment represents a specific model and endpoint, and can be used for chat, embeddings, or fine-tuning operations, depending on its configuration.

Configuration

  • Deployments: Add one or more Service Deployments to the 'Deployments' property. Each deployment should be configured with the correct model ID, endpoint URL, authorization method, and API key as provided by your Azure subscription.
  • Each deployment can target a different model or endpoint, allowing you to use multiple Azure LLM resources within a single provider.

Usage Notes

  • Ensure that each Service Deployment is correctly configured in the Azure portal and that the API key has sufficient permissions.
  • The provider does not automatically discover deployments; you must manually add and configure each one.

Related Types

  • LLM Provider: The base class for all LLM service providers in Grooper.
  • Service Deployment: Represents a single Azure LLM endpoint and its configuration.

Properties

NameTypeDescription
General
Options

See Also

Notification