Supported Providers

any-llm supports the below providers. In order to discover information about what models are supported by a provider as well as what features the provider supports for each model, refer to the provider documentation.

Provider source code can be found in the src/any_llm/providers/ directory of the repository.

Legend

• Key: Environment variable for the API key (e.g., OPENAI_API_KEY).
• Base: Environment variable for a custom API base URL (e.g., OPENAI_BASE_URL). Useful for proxies or self-hosted endpoints.
• Reasoning (Completions): Provider can return reasoning traces alongside the assistant message via the completions and/or streaming endpoints. This does not indicate whether the provider offers separate "reasoning models". See this discussion for more information.
• Streaming (Completions): Provider can stream completion results back as an iterator.
• Image (Completions): Provider supports passing an image_data parameter for vision capabilities, as defined by the OpenAI spec here.
• OpenResponses API: Provider supports the OpenResponses specification for agentic AI systems. See the Responses API docs for usage details.
• List Models API: Provider supports listing available models programmatically via the list_models() function. This allows you to discover what models are available from the provider at runtime, which can be useful for dynamic model selection or validation.

ID	Key	Base	Responses	Completion	Streaming (Completions)	Reasoning (Completions)	Image (Completions)	Embedding	List Models	Batch
anthropic	ANTHROPIC_API_KEY	ANTHROPIC_BASE_URL	❌	✅	✅	✅	✅	❌	✅	❌
azure	AZURE_API_KEY	AZURE_AI_CHAT_ENDPOINT	❌	✅	✅	❌	❌	✅	❌	❌
azureopenai	AZURE_OPENAI_API_KEY	AZURE_OPENAI_ENDPOINT	✅	✅	✅	❌	✅	✅	✅	❌
bedrock	AWS_BEARER_TOKEN_BEDROCK	AWS_ENDPOINT_URL_BEDROCK_RUNTIME	❌	✅	✅	✅	✅	✅	✅	❌
cerebras	CEREBRAS_API_KEY	CEREBRAS_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
cohere	COHERE_API_KEY	COHERE_BASE_URL	❌	✅	✅	✅	❌	❌	✅	❌
databricks	DATABRICKS_TOKEN	DATABRICKS_HOST	❌	✅	✅	✅	❌	✅	❌	❌
deepseek	DEEPSEEK_API_KEY	DEEPSEEK_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
fireworks	FIREWORKS_API_KEY	FIREWORKS_API_BASE	✅	✅	✅	✅	✅	❌	✅	❌
gateway	GATEWAY_API_KEY	GATEWAY_API_BASE	✅	✅	✅	✅	✅	✅	✅	✅
gemini	GEMINI_API_KEY/GOOGLE_API_KEY	GOOGLE_GEMINI_BASE_URL	❌	✅	✅	✅	❌	✅	✅	❌
groq	GROQ_API_KEY	GROQ_BASE_URL	✅	✅	✅	✅	❌	❌	✅	❌
huggingface	HF_TOKEN	HUGGINGFACE_API_BASE	✅	✅	✅	❌	❌	❌	✅	❌
inception	INCEPTION_API_KEY	INCEPTION_API_BASE	❌	✅	✅	❌	❌	❌	✅	❌
llama	LLAMA_API_KEY	LLAMA_API_BASE	❌	✅	✅	❌	❌	❌	✅	❌
llamacpp	None	LLAMACPP_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
llamafile	None	LLAMAFILE_API_BASE	❌	✅	❌	✅	❌	❌	✅	❌
lmstudio	LM_STUDIO_API_KEY	LM_STUDIO_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
minimax	MINIMAX_API_KEY	MINIMAX_API_BASE	❌	✅	✅	✅	❌	❌	❌	❌
mistral	MISTRAL_API_KEY	MISTRAL_API_BASE	❌	✅	✅	✅	❌	✅	✅	✅
moonshot	MOONSHOT_API_KEY	MOONSHOT_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
nebius	NEBIUS_API_KEY	NEBIUS_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
ollama	None	OLLAMA_HOST	❌	✅	✅	✅	✅	✅	✅	❌
openai	OPENAI_API_KEY	OPENAI_BASE_URL	✅	✅	✅	❌	✅	✅	✅	✅
openrouter	OPENROUTER_API_KEY	OPENROUTER_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
perplexity	PERPLEXITY_API_KEY	PERPLEXITY_BASE_URL	❌	✅	✅	❌	✅	❌	❌	❌
platform	ANY_LLM_KEY	ANY_LLM_PLATFORM_URL	✅	✅	✅	✅	✅	✅	✅	✅
portkey	PORTKEY_API_KEY	PORTKEY_API_BASE	❌	✅	✅	✅	✅	❌	✅	❌
sagemaker	AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY	SAGEMAKER_ENDPOINT_URL	❌	✅	✅	❌	✅	✅	❌	❌
sambanova	SAMBANOVA_API_KEY	SAMBANOVA_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
together	TOGETHER_API_KEY	TOGETHER_API_BASE	❌	✅	✅	✅	✅	❌	❌	❌
vertexai		VERTEXAI_API_BASE	❌	✅	✅	✅	❌	✅	✅	❌
vertexaianthropic		VERTEXAI_ANTHROPIC_API_BASE	❌	✅	✅	✅	✅	❌	❌	❌
vllm	VLLM_API_KEY	VLLM_API_BASE	❌	✅	✅	✅	✅	✅	✅	❌
voyage	VOYAGE_API_KEY	VOYAGE_API_BASE	❌	❌	❌	❌	❌	✅	❌	❌
watsonx	WATSONX_API_KEY	WATSONX_URL	❌	✅	✅	❌	✅	❌	✅	❌
xai	XAI_API_KEY	XAI_API_BASE	❌	✅	✅	✅	❌	❌	✅	❌
zai	ZAI_API_KEY	ZAI_BASE_URL	❌	✅	✅	✅	❌	❌	✅	❌