Providers
LLMOps supports 70+ AI providers through its unified gateway. Providers are configured through the LLMOps dashboard, allowing you to add, update, or remove providers without code changes.
- Open the LLMOps dashboard
- Navigate to Settings → Workspace Providers
- Click Add Provider and select your provider
- Enter your API credentials
- Click Save
Once configured, the provider will be available when creating variants in your configs.
All providers support these base options:
| Field | Description |
|---|
| API Key | Your API key for the provider |
| Custom Host | Override the default API endpoint (optional) |
Access GPT-4, GPT-3.5, and other OpenAI models.
| Field | Description |
|---|
| API Key | Your OpenAI API key |
| Organization ID | OpenAI organization ID (optional) |
| Project ID | OpenAI project ID (optional) |
Access Claude 3, Claude 2, and other Anthropic models.
| Field | Description |
|---|
| API Key | Your Anthropic API key |
Access OpenAI models hosted on Azure.
| Field | Description |
|---|
| API Key | Your Azure OpenAI API key |
| Resource Name | Azure resource name |
| Deployment ID | Azure deployment ID |
| API Version | Azure API version (e.g., 2024-02-15-preview) |
| Authentication Mode | API Key, Entra ID, Managed Identity, or Workload Identity |
Access Gemini models via Google AI.
| Field | Description |
|---|
| API Key | Your Google API key |
Access Gemini and other models via Google Cloud Vertex AI.
| Field | Description |
|---|
| Project ID | Google Cloud project ID |
| Region | Vertex AI region (e.g., us-central1) |
| Service Account JSON | Service account credentials JSON |
Access Claude, Llama, and other models via AWS Bedrock.
| Field | Description |
|---|
| AWS Access Key ID | AWS access key ID |
| AWS Secret Access Key | AWS secret access key |
| AWS Region | AWS region (e.g., us-east-1) |
| Session Token | AWS session token (for temporary credentials) |
Fast inference for open-source models.
| Field | Description |
|---|
| API Key | Your Groq API key |
| Field | Description |
|---|
| API Key | Your Together AI API key |
| Field | Description |
|---|
| API Key | Your Fireworks AI API key |
| Field | Description |
|---|
| API Key | Your Cerebras API key |
| Field | Description |
|---|
| API Key | Your SambaNova API key |
| Field | Description |
|---|
| API Key | Your Lambda API key |
| Field | Description |
|---|
| API Key | Your DeepInfra API key |
| Field | Description |
|---|
| API Key | Your DeepSeek API key |
| Field | Description |
|---|
| API Key | Your Mistral AI API key |
| Field | Description |
|---|
| API Key | Your Cohere API key |
| Field | Description |
|---|
| API Key | Your AI21 API key |
| Field | Description |
|---|
| API Key | Your xAI API key |
OpenRouter gives you access to hundreds of models through a single API key.
| Field | Description |
|---|
| API Key | Your OpenRouter API key |
| Field | Description |
|---|
| API Key | Your Perplexity AI API key |
| Field | Description |
|---|
| API Key | Your Jina API key |
| Field | Description |
|---|
| API Key | Your Voyage API key |
| Field | Description |
|---|
| API Key | Your Nomic API key |
| Field | Description |
|---|
| API Key | Your Stability AI API key |
| Field | Description |
|---|
| API Key | Your Replicate API key |
| Field | Description |
|---|
| API Key | Your Segmind API key |
For local models running with Ollama.
| Field | Description |
|---|
| Custom Host | Ollama endpoint (e.g., http://localhost:11434) |
| Field | Description |
|---|
| API Key | Your Hugging Face API key |
| Inference Endpoint URL | Custom inference endpoint (optional) |
Here's the complete list of all 70+ supported providers:
| Provider | Key | Provider | Key |
|---|
| OpenAI | openai | Anthropic | anthropic |
| Azure OpenAI | azure-openai | Google Gemini | google |
| Vertex AI | vertex-ai | AWS Bedrock | bedrock |
| AWS SageMaker | sagemaker | Groq | groq |
| Together AI | together-ai | Fireworks AI | fireworks-ai |
| Cerebras | cerebras | SambaNova | sambanova |
| Lambda | lambda | DeepInfra | deepinfra |
| DeepSeek | deepseek | Mistral AI | mistral-ai |
| Cohere | cohere | AI21 | ai21 |
| xAI | x-ai | OpenRouter | openrouter |
| Perplexity AI | perplexity-ai | Jina | jina |
| Voyage | voyage | Nomic | nomic |
| Stability AI | stability-ai | Replicate | replicate |
| Segmind | segmind | Ollama | ollama |
| Hugging Face | huggingface | Cloudflare Workers AI | workers-ai |
| Anyscale | anyscale | Reka AI | reka-ai |
| Moonshot | moonshot | Zhipu | zhipu |
| LingYi | lingyi | Nebius | nebius |
| Oracle | oracle | Azure AI | azure-ai |