LiteLLM

An open source proxy and SDK that exposes many language model providers behind one OpenAI compatible interface. Readers can learn about provider routing and fallbacks, cost and token tracking, rate limit handling, key management for teams, and self hosting the gateway.