Supported Providers

any-llm supports the below providers. In order to discover information about what models are supported by a provider as well as what features the provider supports for each model, refer to the provider documentation.

Provider	Documentation URL	Environment Variable	Source Code
AWS	https://aws.amazon.com/bedrock/	AWS_BEARER_TOKEN_BEDROCK	Source
Anthropic	https://docs.anthropic.com/en/home	ANTHROPIC_API_KEY	Source
Azure	https://azure.microsoft.com/en-us/products/ai-services/openai-service	AZURE_API_KEY	Source
Cerebras	https://docs.cerebras.ai/	CEREBRAS_API_KEY	Source
Cohere	https://cohere.com/api	CO_API_KEY	Source
DeepSeek	https://platform.deepseek.com/	DEEPSEEK_API_KEY	Source
Fireworks	https://fireworks.ai/api	FIREWORKS_API_KEY	Source
Google	https://cloud.google.com/vertex-ai/docs	-	Source
Groq	https://groq.com/api	GROQ_API_KEY	Source
HuggingFace	https://huggingface.co/inference-endpoints	HF_TOKEN	Source
Inception	https://inceptionlabs.ai/	INCEPTION_API_KEY	Source
Mistral	https://docs.mistral.ai/	MISTRAL_API_KEY	Source
Moonshot AI	https://platform.moonshot.ai/	MOONSHOT_API_KEY	Source
Nebius	https://studio.nebius.ai/	NEBIUS_API_KEY	Source
Ollama	https://github.com/ollama/ollama	-	Source
OpenAI	https://platform.openai.com/docs/api-reference	OPENAI_API_KEY	Source
SambaNova	https://sambanova.ai/	SAMBANOVA_API_KEY	Source
Together	https://together.ai/	TOGETHER_API_KEY	Source
Watsonx	https://www.ibm.com/watsonx	WATSONX_API_KEY	Source
xAI	https://x.ai/	XAI_API_KEY	Source