openai/evals
evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Builder
OpenAI
openai • ai-lab
Stars
18,935
Using upstream star count
Forks
3,024
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Jan 23, 2023
Project creation date
README Summary
> You can now configure and run Evals directly in the OpenAI Dashboard. [Get started →](https://platform.openai.com/docs/guides/evals)
Community Evaluation
Loading…AI Dev Skills
Unmapped
AI Safety EvaluationBenchmark Design and ImplementationCapability AssessmentEvaluation Metrics and ScoringLarge Language Model EvaluationLLM System TestingModel Comparison and AnalysisModel Performance AssessmentPrompt Engineering
Tags
AI Safety EvaluationBenchmark Design and ImplementationCapability AssessmentEvaluation Metrics and ScoringLarge Language Model EvaluationLLM System TestingModel Comparison and AnalysisModel Performance AssessmentPrompt EngineeringData ScienceDatabaseEvalsForkedOpenAIPythonTutorialWeights & Biases
Taxonomy
AI Trends
category
Deployment Context
Modalities
Skill Areas
Recent Activity
Updated 8 months ago
7 Days
0
30 Days
0
90 Days
0
Quality
production- Quality
- high
- Maturity
- production
Categories
Foundation ModelsPrimaryEvals & BenchmarkingObservability & MonitoringSafety & AlignmentData Science & AnalyticsOther AI / MLDev Tools & AutomationLearning Resources
PM Skills
Data & Evaluation
Languages
Python100.0%
Timeline
- Project created
- Jan 23, 2023
- Forked
- Mar 12, 2026
- Your last push
- 8 months ago
- Upstream last push
- 3 months ago
- Tracked since
- Nov 3, 2025
Similar Repos
pgvector cosine similarity · $0
Loading…