Reporium
GraphWikiTaxonomyStacksInsightsTrendsArchitectureAI-NativeFAQ
Ask anything about the repo library…
Loading repo…
←Library/uptrain
Library/uptrainForked

uptrain-ai/uptrain

uptrain

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

View on GitHub↗Upstream uptrain-ai/uptrain↗

Builder

uptrain-ai

uptrain-ai

uptrain-ai • individual

Stars

2,350

Using upstream star count

Forks

202

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Nov 7, 2022

Project creation date

README Summary

<h4 align="center"> <a href="https://uptrain.ai"> <img alt="Logo of UpTrain - an open-source platform to evaluate and improve LLM applications" src="https://github.com/uptrain-ai/uptrain/assets/108270398/b6a4905f-63fd-47ab-a894-1026a6669c86"/> </a> </h4>

Community Evaluation

Loading…

AI Dev Skills

Unmapped

AI Application Quality AssuranceAI Model Performance MonitoringCode Generation EvaluationEmbedding Quality AnalysisGenerative AI EvaluationLarge Language Model TestingNatural Language Processing EvaluationRetrieval-Augmented Generation Assessment

Tags

AI Application Quality AssuranceAI Model Performance MonitoringCode Generation EvaluationEmbedding Quality AnalysisGenerative AI EvaluationLarge Language Model TestingNatural Language Processing EvaluationRetrieval-Augmented Generation AssessmentAnthropic / ClaudeBenchmarkingChromaClaudeDockerEmbeddingsEvalsForkedGPTHeliconeHuggingFaceJupyterLangfuseLarge Language ModelsLlamaIndexMistralOllamaOpenAIPlanning / CoTPrompt InjectionPythonQdrantRerankingResearch / PapersSecurityTutorial

Taxonomy

AI Trends

AI SafetyLLM EvaluationGenerative AI Quality ControlAI Observability

category

Foundation ModelsAI AgentsRAG & RetrievalEvals & BenchmarkingInference & ServingMLOps & InfrastructureDev Tools & AutomationLearning ResourcesSecurity & SafetyData Science & Analytics

Deployment Context

Self-hostedCloud APIOn-premise

Industries

Developer ToolsAI/ML Platforms

Modalities

TextCode

Skill Areas

Generative AI EvaluationLarge Language Model TestingRetrieval-Augmented Generation AssessmentCode Generation EvaluationEmbedding Quality AnalysisAI Model Performance MonitoringNatural Language Processing EvaluationAI Application Quality Assurance

tag

Anthropic / ClaudeBenchmarkingChromaClaudeDockerEmbeddingsEvalsForkedGPTHeliconeHuggingFaceJupyterLangfuseLarge Language ModelsLlamaIndexMistralOllamaOpenAIPlanning / CoTPrompt InjectionPythonQdrantRerankingResearch / PapersSecurityTutorial

Use Cases

LLM Application TestingGenerative AI Quality AssuranceAI Model Performance MonitoringCode Generation EvaluationRAG System AssessmentEmbedding Quality AnalysisAI Application Debugging

Recent Activity

Updated 1 years ago

7 Days

0

30 Days

0

90 Days

0

Quality

beta
Quality
medium
Maturity
beta

Categories

RAG & RetrievalPrimaryEvals & BenchmarkingInference & ServingMLOps & InfrastructureDev Tools & AutomationLearning ResourcesSecurity & SafetyData Science & AnalyticsFoundation ModelsAI AgentsSearch & KnowledgeOther AI / ML

PM Skills

AI-Native ArchitectureData & EvaluationProduct DiscoverySafety & AlignmentScale & Reliability

Languages

Python100.0%

Timeline

Project created
Nov 7, 2022
Forked
Mar 22, 2026
Your last push
1 years ago
Upstream last push
1 years ago
Tracked since
Aug 18, 2024

Similar Repos

pgvector cosine similarity · $0

Loading…