Skip to main content

Overview

LiteLLM provides a unified OpenAI-compatible interface to access 100+ LLM providers including OpenAI, Anthropic, Azure, Google, AWS Bedrock, and more. Run it as a proxy server for centralized model management. Model Class: OpenAIChatModel (OpenAI-compatible proxy)

Authentication

Examples

Model Settings

You can set model parameters in two ways: on the model or on the Agent. On the model:
On the Agent:

Parameters