BerriAI/litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
42,897 ★7,157 forksPython
43
SINT
Score Breakdown
15%
Activity
31%
Quality
50%
Response
83%
Trust
20%
Agent Ready
100%
Relevance
Badge for README
[](https://discovery-api-production-19d9.up.railway.app/badge/redirect/16)