Skip to content

Providers

Auto AI Router supports multiple LLM providers. Each provider type has its own authentication method and required configuration fields.

Provider Comparison

Provider Type Required Fields Auth Method
OpenAI openai api_key, base_url API Key
Anthropic anthropic api_key, base_url API Key
Vertex AI vertex-ai project_id, location, credentials_file or credentials_json OAuth2 / Service Account
Gemini AI Studio gemini api_key, base_url API Key
Proxy proxy base_url Optional API Key

Common Fields

All credential types share these fields:

Field Type Description
name string Unique identifier for this credential
rpm int Requests per minute limit (-1 = unlimited)
tpm int Tokens per minute limit (-1 = unlimited)
is_fallback bool Use only when primary credentials are exhausted