You can use litellm through either: LiteLLM Proxy Server - Server (LLM Gateway) to call 100+ LLMs, load balance, cost tracking across projects LiteLLM python SDK - Python Client to call 100+ LLMs, load balance, cost tracking github.com/BerriAI/litellm