Supported Providers

any-llm supports the below providers. In order to discover information about what models are supported by a provider as well as what features the provider supports for each model, refer to the provider documentation.

Provider source code can be found in the src/any_llm/providers/ directory of the repository.

Legend

• Reasoning (Completions): Provider can return reasoning traces alongside the assistant message via the completions and/or streaming endpoints. This does not indicate whether the provider offers separate "reasoning models".See this
• Streaming (Completions): Provider can stream completion results back as an iterator. discussion for more information.
• Image (Completions): Provider supports passing an image_data parameter for vision capabilities, as defined by the OpenAI spec here.
• Responses API: Provider supports the Responses API variant for text generation. See this to follow along with our implementation effort.
• List Models API: Provider supports listing available models programmatically via the list_models() function. This allows you to discover what models are available from the provider at runtime, which can be useful for dynamic model selection or validation.

ID	Env Var	Responses	Completion	Streaming (Completions)	Reasoning (Completions)	Image (Completions)	Embedding	List Models	Batch
anthropic	ANTHROPIC_API_KEY	❌	✅	✅	✅	✅	❌	✅	❌
azure	AZURE_API_KEY	❌	✅	✅	❌	❌	✅	❌	❌
azureopenai	AZURE_OPENAI_API_KEY	✅	✅	✅	❌	✅	✅	✅	❌
bedrock	AWS_BEARER_TOKEN_BEDROCK	❌	✅	✅	✅	❌	✅	✅	❌
cerebras	CEREBRAS_API_KEY	❌	✅	✅	✅	❌	❌	✅	❌
cohere	COHERE_API_KEY	❌	✅	✅	✅	❌	❌	✅	❌
databricks	DATABRICKS_TOKEN	❌	✅	✅	✅	❌	✅	❌	❌
deepseek	DEEPSEEK_API_KEY	❌	✅	✅	✅	❌	❌	✅	❌
fireworks	FIREWORKS_API_KEY	✅	✅	✅	✅	✅	❌	✅	❌
gateway	GATEWAY_API_KEY	✅	✅	✅	✅	✅	✅	✅	✅
gemini	GEMINI_API_KEY/GOOGLE_API_KEY	❌	✅	✅	✅	❌	✅	✅	❌
groq	GROQ_API_KEY	✅	✅	✅	✅	❌	❌	✅	❌
huggingface	HF_TOKEN	❌	✅	✅	✅	❌	❌	✅	❌
inception	INCEPTION_API_KEY	❌	✅	✅	❌	❌	❌	✅	❌
llama	LLAMA_API_KEY	❌	✅	✅	❌	❌	❌	✅	❌
llamacpp	None	❌	✅	✅	✅	✅	✅	✅	❌
llamafile	None	❌	✅	❌	✅	❌	❌	✅	❌
lmstudio	LM_STUDIO_API_KEY	❌	✅	✅	✅	✅	✅	✅	❌
minimax	MINIMAX_API_KEY	❌	✅	✅	✅	❌	❌	❌	❌
mistral	MISTRAL_API_KEY	❌	✅	✅	✅	❌	✅	✅	❌
moonshot	MOONSHOT_API_KEY	❌	✅	✅	✅	❌	❌	✅	❌
nebius	NEBIUS_API_KEY	❌	✅	✅	✅	✅	✅	✅	❌
ollama	None	❌	✅	✅	✅	✅	✅	✅	❌
openai	OPENAI_API_KEY	✅	✅	✅	❌	✅	✅	✅	✅
openrouter	OPENROUTER_API_KEY	❌	✅	✅	✅	✅	❌	✅	❌
perplexity	PERPLEXITY_API_KEY	❌	✅	✅	❌	✅	❌	❌	❌
portkey	PORTKEY_API_KEY	❌	✅	✅	✅	✅	❌	✅	❌
sagemaker	AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY	❌	✅	✅	❌	✅	✅	❌	❌
sambanova	SAMBANOVA_API_KEY	❌	✅	✅	✅	✅	✅	✅	❌
together	TOGETHER_API_KEY	❌	✅	✅	✅	✅	❌	❌	❌
vertexai		❌	✅	✅	✅	❌	✅	✅	❌
voyage	VOYAGE_API_KEY	❌	❌	❌	❌	❌	✅	❌	❌
watsonx	WATSONX_API_KEY	❌	✅	✅	❌	✅	❌	✅	❌
xai	XAI_API_KEY	❌	✅	✅	✅	❌	❌	✅	❌
zai	ZAI_API_KEY	❌	✅	✅	✅	❌	❌	✅	❌