Supported Providers

any-llm supports {n} providers. Click any provider to see its supported features and configuration. Provider source code is in src/any_llm/providers/.

ID	Key	Base	Responses	Completion	Streaming (Completions)	Reasoning (Completions)	Image (Completions)	Embedding	List Models	Batch
anthropic	ANTHROPIC_API_KEY	ANTHROPIC_BASE_URL	❌	✅	✅	✅	✅	❌	✅	❌
azure	AZURE_API_KEY	AZURE_AI_CHAT_ENDPOINT	❌	✅	✅	❌	❌	✅	❌	❌
azureanthropic	AZURE_ANTHROPIC_API_KEY	AZURE_ANTHROPIC_API_BASE	❌	✅	✅	✅	✅	❌	❌	❌
azureopenai	AZURE_OPENAI_API_KEY	AZURE_OPENAI_ENDPOINT	✅	✅	✅	❌	✅	✅	✅	❌
bedrock	AWS_BEARER_TOKEN_BEDROCK	AWS_ENDPOINT_URL_BEDROCK_RUNTIME	❌	✅	✅	✅	✅	✅	✅	❌
cerebras	CEREBRAS_API_KEY	CEREBRAS_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
cohere	COHERE_API_KEY	COHERE_BASE_URL	❌	✅	✅	✅	❌	❌	✅	❌
databricks	DATABRICKS_TOKEN	DATABRICKS_HOST	❌	✅	✅	✅	❌	✅	❌	❌
deepseek	DEEPSEEK_API_KEY	DEEPSEEK_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
fireworks	FIREWORKS_API_KEY	FIREWORKS_API_BASE	✅	✅	✅	✅	✅	❌	✅	❌
gateway	GATEWAY_API_KEY	GATEWAY_API_BASE	✅	✅	✅	✅	✅	✅	✅	✅
gemini	GEMINI_API_KEY/GOOGLE_API_KEY	GOOGLE_GEMINI_BASE_URL	❌	✅	✅	✅	❌	✅	✅	❌
groq	GROQ_API_KEY	GROQ_BASE_URL	✅	✅	✅	✅	❌	❌	✅	❌
huggingface	HF_TOKEN	HUGGINGFACE_API_BASE	✅	✅	✅	❌	❌	❌	✅	❌
inception	INCEPTION_API_KEY	INCEPTION_API_BASE	❌	✅	✅	❌	❌	❌	✅	❌
llama	LLAMA_API_KEY	LLAMA_API_BASE	❌	✅	✅	❌	❌	❌	✅	❌
llamacpp	None	LLAMACPP_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
llamafile	None	LLAMAFILE_API_BASE	❌	✅	❌	✅	❌	❌	✅	❌
lmstudio	LM_STUDIO_API_KEY	LM_STUDIO_API_BASE	✅	✅	✅	✅	✅	✅	✅	❌
minimax	MINIMAX_API_KEY	MINIMAX_API_BASE	❌	✅	✅	✅	❌	❌	❌	❌
mistral	MISTRAL_API_KEY	MISTRAL_API_BASE	❌	✅	✅	✅	❌	✅	✅	✅
moonshot	MOONSHOT_API_KEY	MOONSHOT_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
mzai	ANY_LLM_KEY	ANY_LLM_PLATFORM_URL	❌	✅	✅	✅	✅	✅	✅	❌
nebius	NEBIUS_API_KEY	NEBIUS_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
ollama	None	OLLAMA_HOST	❌	✅	✅	✅	✅	✅	✅	❌
openai	OPENAI_API_KEY	OPENAI_BASE_URL	✅	✅	✅	❌	✅	✅	✅	✅
openrouter	OPENROUTER_API_KEY	OPENROUTER_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
perplexity	PERPLEXITY_API_KEY	PERPLEXITY_BASE_URL	❌	✅	✅	❌	✅	❌	❌	❌
portkey	PORTKEY_API_KEY	PORTKEY_API_BASE	❌	✅	✅	✅	✅	❌	✅	❌
sagemaker	AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY	SAGEMAKER_ENDPOINT_URL	❌	✅	✅	❌	✅	✅	❌	❌
sambanova	SAMBANOVA_API_KEY	SAMBANOVA_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
together	TOGETHER_API_KEY	TOGETHER_API_BASE	❌	✅	✅	✅	✅	❌	❌	❌
vertexai		VERTEXAI_API_BASE	❌	✅	✅	✅	❌	✅	✅	❌
vertexaianthropic		VERTEXAI_ANTHROPIC_API_BASE	❌	✅	✅	✅	✅	❌	❌	❌
vllm	VLLM_API_KEY	VLLM_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
voyage	VOYAGE_API_KEY	VOYAGE_API_BASE	❌	❌	❌	❌	❌	✅	❌	❌
watsonx	WATSONX_API_KEY	WATSONX_URL	❌	✅	✅	❌	✅	❌	✅	❌
xai	XAI_API_KEY	XAI_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
zai	ZAI_API_KEY	ZAI_BASE_URL	❌	✅	✅	✅	❌	❌	✅	❌