LiteLLM
litellm.aiLLM Gateway to manage auth, loadbalancing, and spend tracking across 100+ LLMs
Dev Toolsllmopenai-proxyai-gatewayload-balancingapi-managementllm-opsmulti-provider
About
LiteLLM is an LLM gateway that acts as an OpenAI-compatible proxy, enabling teams to manage authentication, load balancing, and spend tracking across 100+ large language models. It provides a unified API in the OpenAI format, abstracting away the differences between providers like Azure, Gemini, Bedrock, and OpenAI. It is designed to give developers centralized access and control over multiple LLM providers.
Problem
Managing authentication, load balancing, and cost tracking across many different LLM providers is complex and fragmented.
For
developers and engineering teams working with multiple LLM providers
How it works
LiteLLM acts as a proxy gateway that standardizes all LLM provider APIs into the OpenAI format, handling auth, routing, and spend tracking centrally.
Business model
freemium
Status
launched