LLM Provider

LLM Providers define web service connections to large language models, and enable the use of LLM_based AI functionality in Grooper.

Remarks

Large Language Model (LLM) providers enable Grooper to connect with external AI services for advanced language processing tasks such as chat, embeddings, and fine-tuning.

Overview

The LLM Provider base class defines the contract for all LLM service integrations in Grooper. It is not used directly, but is implemented by specific providers such as Open AI Provider and Azure Provider.

Providers manage the connection details, authentication, and available models for their respective services. Each implementation exposes a set of models and capabilities, and may support different configuration patterns:

• The Open AI Provider connects to OpenAI or compatible APIs using a single endpoint and API key.
• The Azure Provider manages a collection of Service Deployments, each representing a specific Azure-hosted model and endpoint.

Configuration

To use an LLM provider:

1. Add a provider object (such as Open AI Provider or Azure Provider) to your project or configuration.
2. Set the required connection properties, such as 'URL', 'Authorization', and 'API Key', or add Service Deployments as needed.
3. Enable or disable the provider using the 'Enabled' property.
4. Adjust timeouts and other options to match your service requirements.

The available models and features depend on the provider type and your service subscription.

Usage Notes

• Each provider exposes lists of available model IDs for chat, embeddings, and other operations.
• Use the 'Timeout' and 'Completion Timeout' properties to control how long Grooper waits for responses from the service.
• The 'Enabled' property allows you to temporarily disable a provider without removing its configuration.
• Some providers (such as Azure Provider) support multiple deployments, allowing you to target different models or endpoints within a single provider.

Extensibility

To implement a custom LLM provider in an Object Library, inherit from LLM Provider and override the required members to supply model lists, connection logic, and service instantiation.

Related Types

• Open AI Provider: Connects to OpenAI or compatible APIs.
• Azure Provider: Connects to Azure-hosted LLM deployments.
• Service Deployment: Represents a single model/endpoint configuration (used by Azure Provider).

Properties

Name	Type		Description
General
Name	String	►	The name of this provider. Requiredtrue Specifies a display name for the provider instance. Used to identify the provider in configuration UIs and logs. By default, this is set to the provider's kind (such as "OpenAI" or "Azure"). You may assign a custom name to distinguish between multiple providers of the same type.
Options
Timeout	Int32	►	The timeout for web service calls, in seconds. Default20 Min1 Sets the maximum time (in seconds) Grooper will wait for a response from the LLM service for standard API operations. Applies to most API requests except for long-running completion operations. Increase this value if you experience timeouts with slow or distant services. The default value is 20 seconds.
Completion Timeout	Int32	►	The timeout for completion operations, in seconds. Default240 Min1 Sets the maximum time (in seconds) Grooper will wait for completion-type operations, such as generating a response from a language model. Use a higher value for models or operations that may take longer to complete. The default value is 240 seconds.
Enabled	Boolean	►	Set this property to false to temporarily disable this provider. DefaultTrue Enables or disables the provider without removing its configuration. When set to false, the provider will not be used for LLM operations. Use this to temporarily take a provider offline for maintenance or troubleshooting. The default value is true (enabled).

Derived Types

There are 3 implementations of LLM Provider.

Azure Provider	Defines a connection to one or more Azure LLM service deployments.
GCS Provider	Defines a connection to Grooper Cloud Services.
Open AI Provider	Defines a connection to the OpenAI API or an OpenAI-compatible service for use as an LLM provider in Grooper.

Used By

LLM Connector