Reporium
GraphWikiTaxonomyStacksInsightsTrendsArchitectureAI-NativeFAQ
Ask anything about the repo library…
Loading repo…
←Library/litellm
Library/litellmForked

BerriAI/litellm

litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

View on GitHub↗Upstream BerriAI/litellm↗

Builder

BerriAI

BerriAI

BerriAI • individual

Stars

48,737

Using upstream star count

Forks

8,480

Using upstream fork count

Open Issues

0

Activity Score

0/100

1097 commits in 30d

Created

Jul 27, 2023

Project creation date

README Summary

<h1 align="center"> 🚅 LiteLLM </h1> <p align="center"> <p align="center">Call 100+ LLMs in OpenAI format. [Bedrock, Azure, OpenAI, VertexAI, Anthropic, Groq, etc.] </p> <p align="center"> <a href="https://render.com/deploy?repo=https://github.com/BerriAI/litellm" target="_blank" rel="nofollow"><img src="https://render.com/images/deploy-to-render-button.svg" alt="Deploy to Render"></a> <a href="https://railway.app/template/HLP0Ub?referralCod

Community Evaluation

Loading…

AI Dev Skills

Unmapped

AI Gateway ArchitectureAI Guardrails ImplementationAI Model RoutingAPI Rate Limiting and Load BalancingCost Tracking and AnalyticsEnterprise AI InfrastructureLarge Language Model API IntegrationLLM Proxy Server DevelopmentMulti-Provider LLM OrchestrationOpenAI API Compatibility

Tags

AI Gateway ArchitectureAI Guardrails ImplementationAI Model RoutingAPI Rate Limiting and Load BalancingCost Tracking and AnalyticsEnterprise AI InfrastructureLarge Language Model API IntegrationLLM Proxy Server DevelopmentMulti-Provider LLM OrchestrationOpenAI API CompatibilityAI AgentsAWS BedrockAnthropic / ClaudeAzure AICachingClaudeDeepSeekDockerEmbeddingsForkedGoogle AIGoogle CloudHuggingFaceLLM ServingLangGraphLangfuseLarge Language ModelsLiteLLMLlamafileMCPMLflowMistralOllamaOpenAIOpenAI Agents SDKOpenHandsPydanticPythonRerankingSageMakerSecurityStructured OutputTutorialVertex AIWeights & BiasesvLLM

Taxonomy

AI Trends

Compound AI SystemsLLM API StandardizationEnterprise AI GovernanceMulti-Model AI Architectures

category

Foundation ModelsAI AgentsRAG & RetrievalObservability & MonitoringInference & ServingMLOps & InfrastructureDev Tools & AutomationCloud & PlatformsLearning ResourcesSecurity & Safety

Deployment Context

Cloud APISelf-hostedOn-premiseServerless

Modalities

Text

Skill Areas

Large Language Model API IntegrationAI Gateway ArchitectureMulti-Provider LLM OrchestrationCost Tracking and AnalyticsAPI Rate Limiting and Load BalancingAI Model RoutingEnterprise AI InfrastructureLLM Proxy Server DevelopmentAI Guardrails ImplementationOpenAI API Compatibility

tag

AI AgentsAWS BedrockAnthropic / ClaudeAzure AICachingClaudeDeepSeekDockerEmbeddingsForkedGoogle AIGoogle CloudHuggingFaceLLM ServingLangGraphLangfuseLarge Language ModelsLiteLLMLlamafileMCPMLflowMistralOllamaOpenAIOpenAI Agents SDKOpenHandsPydanticPythonRerankingSageMakerSecurityStructured OutputTutorialVertex AIWeights & BiasesvLLM

Use Cases

Multi-LLM Provider ManagementEnterprise AI Cost OptimizationLLM API Load BalancingAI Model Fallback and RoutingCentralized LLM Access ControlAI Usage Analytics and MonitoringCross-Provider LLM IntegrationAI Gateway Implementation

Recent Activity

Updated 2 months ago

7 Days

143

30 Days

1097

90 Days

6708

chore: regenerate poetry.lock to match pyproject.toml (#23514)

github-actions[bot] • Mar 13, 2026

9cd7ad2

Merge pull request #23496 from BerriAI/bump_ver_1822

yuneng-jiang • Mar 13, 2026

ef78fa7

fix(gemini): preserve toolConfig on native generate_content (#23493)

Emerson Gomes • Mar 13, 2026

92d39c3

Quality

production
Quality
high
Maturity
production

Categories

Foundation ModelsPrimaryAI AgentsRAG & RetrievalObservability & MonitoringInference & ServingSafety & AlignmentOther AI / MLMLOps & InfrastructureDev Tools & AutomationCloud & PlatformsLearning ResourcesSecurity & Safety

PM Skills

Cost & EfficiencyScale & ReliabilityData & EvaluationProduct DiscoveryDeveloper PlatformAI-Native Architecture

Languages

Python100.0%

Timeline

Project created
Jul 27, 2023
Forked
Mar 13, 2026
Your last push
2 months ago
Upstream last push
15 days ago
Tracked since
Mar 13, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…