Library/bifrost
Library/bifrostForked

maximhq/bifrost

bifrost

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

Builder

maximhq

maximhq

maximhq • individual

Stars

3,326

Using upstream star count

Forks

356

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Mar 19, 2025

Project creation date

README Summary

Bifrost is a high-performance AI gateway designed for enterprise use that provides load balancing, routing, and management for over 1000 AI models. It serves as infrastructure for organizations needing to manage multiple AI model deployments with low latency and high throughput.

AI Dev Skills

Unmapped

AI Gateway ArchitectureLoad Balancing for ML SystemsModel Routing and SelectionAPI Gateway DesignHigh-Performance ComputingDistributed SystemsAI Model ManagementRequest Orchestration

Tags

AI Gateway ArchitectureLoad Balancing for ML SystemsModel Routing and SelectionAPI Gateway DesignHigh-Performance ComputingDistributed SystemsAI Model ManagementRequest OrchestrationAI Platform ServicesAI InfrastructureHigh-Throughput AI API ManagementModel Serving InfrastructureMultimodalCloud ComputingEnterprise AI Model ServingEnterprise AIModel ServingEnterprise SoftwareLatency OptimizationCloud APICluster ManagementDeveloper ToolsAI Infrastructure OptimizationConcurrent Request HandlingAI Model OrchestrationMulti-Model Load BalancingOn-premiseClusterLoad BalancingSelf-hostedTextProduction AI DeploymentGo

Taxonomy

Recent Activity

Updated 1 months ago

7 Days

0

30 Days

0

90 Days

0

Quality

beta
Quality
medium
Maturity
beta

Categories

Dev Tools & AutomationPrimaryMultimodal AIOther AI / MLInference & ServingML Platform & InfrastructureFoundation Models

PM Skills

Developer Platform

Languages

Go100.0%

Timeline

Project created
Mar 19, 2025
Forked
Mar 13, 2026
Your last push
1 months ago
Upstream last push
6 days ago
Tracked since
Mar 13, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…