Providers LLMOps supports 70+ AI providers through its unified gateway. This page lists all supported providers and their configuration options.
All providers share these base options:
Property Type Required Description apiKeystringYes API key for the provider customHoststringNo Custom base URL for the provider requestTimeoutnumberNo Request timeout in milliseconds forwardHeadersstring[]No Headers to forward from incoming requests
providers : {
openai : {
apiKey : process.env. OPENAI_API_KEY ,
openaiOrganization : 'org-xxx' , // Optional
openaiProject : 'proj-xxx' , // Optional
},
}
Property Type Description openaiOrganizationstringOpenAI organization ID openaiProjectstringOpenAI project ID
providers : {
anthropic : {
apiKey : process.env. ANTHROPIC_API_KEY ,
},
}
providers : {
'azure-openai' : {
apiKey: process.env. AZURE_OPENAI_API_KEY ,
resourceName: 'my-resource' ,
deploymentId: 'gpt-4' ,
apiVersion: '2024-02-15-preview' ,
},
}
Property Type Description resourceNamestringAzure resource name deploymentIdstringAzure deployment ID apiVersionstringAzure API version
providers : {
google : {
apiKey : process.env. GOOGLE_API_KEY ,
},
}
providers : {
'vertex-ai' : {
apiKey: '' , // Required but not used
vertexProjectId: 'my-project' ,
vertexRegion: 'us-central1' ,
vertexServiceAccountJson: {
// Your service account JSON credentials
},
},
}
Property Type Description vertexProjectIdstringGoogle Cloud project ID vertexRegionstringVertex AI region (e.g., us-central1) vertexServiceAccountJsonobjectService account JSON credentials
providers : {
bedrock : {
apiKey : '' , // Required but not used
awsAccessKeyId : process.env. AWS_ACCESS_KEY_ID ,
awsSecretAccessKey : process.env. AWS_SECRET_ACCESS_KEY ,
awsRegion : 'us-east-1' ,
},
}
Property Type Description awsAccessKeyIdstringAWS access key ID awsSecretAccessKeystringAWS secret access key awsSessionTokenstringAWS session token (for temporary credentials) awsRegionstringAWS region (e.g., us-east-1)
providers : {
groq : {
apiKey : process.env. GROQ_API_KEY ,
},
}
providers : {
'together-ai' : {
apiKey: process.env. TOGETHER_API_KEY ,
},
}
providers : {
'fireworks-ai' : {
apiKey: process.env. FIREWORKS_API_KEY ,
},
}
providers : {
cerebras : {
apiKey : process.env. CEREBRAS_API_KEY ,
},
}
providers : {
sambanova : {
apiKey : process.env. SAMBANOVA_API_KEY ,
},
}
providers : {
lambda : {
apiKey : process.env. LAMBDA_API_KEY ,
},
}
providers : {
deepinfra : {
apiKey : process.env. DEEPINFRA_API_KEY ,
},
}
providers : {
deepseek : {
apiKey : process.env. DEEPSEEK_API_KEY ,
},
}
providers : {
'mistral-ai' : {
apiKey: process.env. MISTRAL_API_KEY ,
},
}
providers : {
cohere : {
apiKey : process.env. COHERE_API_KEY ,
},
}
providers : {
ai21 : {
apiKey : process.env. AI21_API_KEY ,
},
}
providers : {
'x-ai' : {
apiKey: process.env. XAI_API_KEY ,
},
}
OpenRouter gives you access to hundreds of models through a single API key.
providers : {
openrouter : {
apiKey : process.env. OPENROUTER_API_KEY ,
},
}
providers : {
'perplexity-ai' : {
apiKey: process.env. PERPLEXITY_API_KEY ,
},
}
providers : {
jina : {
apiKey : process.env. JINA_API_KEY ,
},
}
providers : {
voyage : {
apiKey : process.env. VOYAGE_API_KEY ,
},
}
providers : {
nomic : {
apiKey : process.env. NOMIC_API_KEY ,
},
}
providers : {
'stability-ai' : {
apiKey: process.env. STABILITY_API_KEY ,
},
}
providers : {
replicate : {
apiKey : process.env. REPLICATE_API_KEY ,
},
}
providers : {
segmind : {
apiKey : process.env. SEGMIND_API_KEY ,
},
}
For local models running with Ollama:
providers : {
ollama : {
apiKey : '' , // Required but not used
customHost : 'http://localhost:11434' ,
},
}
providers : {
huggingface : {
apiKey : process.env. HF_API_KEY ,
huggingfaceBaseUrl : 'https://api-inference.huggingface.co' , // Optional
},
}
Here's the complete list of all 70+ supported providers:
Provider Key Provider Key OpenAI openaiAnthropic anthropicAzure OpenAI azure-openaiGoogle Gemini googleVertex AI vertex-aiAWS Bedrock bedrockAWS SageMaker sagemakerGroq groqTogether AI together-aiFireworks AI fireworks-aiCerebras cerebrasSambaNova sambanovaLambda lambdaDeepInfra deepinfraDeepSeek deepseekMistral AI mistral-aiCohere cohereAI21 ai21xAI x-aiOpenRouter openrouterPerplexity AI perplexity-aiJina jinaVoyage voyageNomic nomicStability AI stability-aiReplicate replicateSegmind segmindOllama ollamaHugging Face huggingfaceCloudflare Workers AI workers-aiAnyscale anyscaleReka AI reka-aiMoonshot moonshotZhipu zhipuLingYi lingyiNebius nebiusOracle oracleAzure AI azure-ai