LiteLLM

Open-source AI gateway that unifies 140+ LLM providers and 1,892 models behind one OpenAI-compatible API, with automatic cost tracking, hard budget caps, load balancing and auto-routing, caching, and governance (SSO, RBAC, audit logs). Self-host in your own cloud or fully air-gapped.