ragas

Supercharge Your LLM Application Evaluations 🚀

View on GitHub↗Upstream vibrantlabsai/ragas↗

Builder

vibrantlabsai

vibrantlabsai • individual

Stars

13,203

Using upstream star count

Forks

1,329

Using upstream fork count

Open Issues

Activity Score

0/100

0 commits in 30d

Created

May 8, 2023

Project creation date

README Summary

Ragas is a framework for evaluating Retrieval Augmented Generation (RAG) pipelines and LLM applications using synthetic test data generation and LLM-based metrics. It provides evaluation metrics for faithfulness, answer relevancy, context precision, and context recall without requiring human annotations. The tool integrates with popular frameworks like LangChain, LlamaIndex, and supports various LLM providers.

AI Dev Skills

Unmapped

Tags

Retrieval-Augmented GenerationLarge Language Model EvaluationInformation Retrieval MetricsNatural Language Generation AssessmentQuestion Answering SystemsLLM Application DevelopmentEvaluation Framework DesignRAG Pipeline OptimizationLLM EvaluationEnterprise AITextCloud APIFinancial ServicesLegal TechQuestion Answering Quality AssessmentHealthcareEnterprise SoftwareCompound AI SystemsRAG System EvaluationRetrieval Pipeline BenchmarkingInformation Retrieval EvaluationAutomated LLM TestingSelf-hostedResearch & AcademiaOn-premiseDeveloper ToolsRAG Model ComparisonLLM Application Performance MeasurementAI SafetyPython

Recent Activity

Updated 1 months ago

7 Days

30 Days

90 Days

Quality

beta

Quality: high
Maturity: beta

PM Skills

Scale & ReliabilityDeveloper Platform

Languages

Python100.0%

Timeline

Project created: May 8, 2023
Forked: Mar 13, 2026
Your last push: 1 months ago
Upstream last push: 1 months ago
Tracked since: Feb 24, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…