Intro

any-llm is a Python library providing a single interface to different llm providers.

Try any-llm in action with our interactive chat demo that showcases streaming completions and provider switching:

The demo features real-time streaming responses, multiple provider support, and collapsible "thinking" content display.

Refer to the Quickstart for instructions on installation and usage.

For a complete list of available functions and their parameters, see the completion, embedding, and responses API documentation.

any-llm provides custom exceptions to indicate common errors like missing API keys and parameters that are unsupported by a specific provider.

For more details on exceptions, see the exceptions API documentation.

For AI Systems

This documentation is available in two AI-friendly formats:

llms.txt - A structured overview with curated links to key documentation sections
llms-full.txt - Complete documentation content concatenated into a single file