←Library/tensorzero
Library/tensorzeroForked

tensorzero/tensorzero

tensorzero

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, optimization, evaluation, and experimentation.

View on GitHub↗Upstream tensorzero/tensorzero↗

Builder

tensorzero

tensorzero

tensorzero • individual

Stars

11,161

Using upstream star count

Forks

797

Using upstream fork count

Open Issues

0

Activity Score

0/100

143 commits in 30d

Created

Jul 16, 2024

Project creation date

README Summary

TensorZero is an open-source LLMOps platform built in Rust that provides a unified solution for managing large language model operations. It combines an LLM gateway, observability tools, optimization capabilities, evaluation frameworks, and experimentation features into a single platform. The platform aims to streamline the deployment, monitoring, and improvement of LLM-based applications in production environments.

AI Dev Skills

Unmapped

LLMOps Platform ArchitectureLarge Language Model Gateway DesignML Model ObservabilityML Experimentation and A/B TestingLLM Performance OptimizationML Model Evaluation FrameworksProduction ML System DesignDistributed Systems for MLAPI Gateway Architecture

Tags

LLMOps Platform ArchitectureLarge Language Model Gateway DesignML Model ObservabilityML Experimentation and A/B TestingLLM Performance OptimizationML Model Evaluation FrameworksProduction ML System DesignDistributed Systems for MLAPI Gateway ArchitectureSelf-hostedProduction LLM Performance MonitoringOn-premiseLLM Application Deployment and ManagementLLMOps and ML Platform EngineeringLLM Cost and Latency OptimizationAI Observability and MonitoringMulti-model AI SystemsCompound AI SystemsTextCloud APIMulti-model LLM Routing and Load BalancingLLM Response Quality EvaluationEnterprise LLM Governance and ComplianceA/B Testing for Language ModelsProduction AI GovernanceRust

Taxonomy

Modalities

Text

Recent Activity

Updated 23 days ago

7 Days

5

30 Days

143

90 Days

915

Quality

beta
Quality
medium
Maturity
beta

Categories

Observability & MonitoringPrimaryInference & ServingOther AI / MLDev Tools & AutomationEvals & BenchmarkingML Platform & InfrastructureFinance & LegalFoundation Models

PM Skills

Developer Platform

Languages

Rust100.0%

Timeline

Project created
Jul 16, 2024
Forked
Mar 22, 2026
Your last push
23 days ago
Upstream last push
7 days ago
Tracked since
Mar 21, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…