promptfoo/promptfoo
promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
Builder
promptfoo
promptfoo • individual
Stars
21,716
Using upstream star count
Forks
1,914
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Apr 28, 2023
Project creation date
README Summary
<p align="center"> <a href="https://npmjs.com/package/promptfoo"><img src="https://img.shields.io/npm/v/promptfoo" alt="npm"></a> <a href="https://npmjs.com/package/promptfoo"><img src="https://img.shields.io/npm/dm/promptfoo" alt="npm"></a> <a href="https://github.com/promptfoo/promptfoo/actions/workflows/main.yml"><img src="https://img.shields.io/github/actions/workflow/status/promptfoo/promptfoo/main.yml" alt="GitHub Workflow Status"></a> <a href="https://github.com/promptfoo/promptfo
Community Evaluation
Loading…AI Dev Skills
Unmapped
AI Red TeamingAI Security TestingAI System TestingAI Vulnerability AssessmentLanguage Model EvaluationMulti-model ComparisonPrompt EngineeringRetrieval-Augmented Generation
Tags
AI Red TeamingAI Security TestingAI System TestingAI Vulnerability AssessmentLanguage Model EvaluationMulti-model ComparisonPrompt EngineeringRetrieval-Augmented GenerationAWS BedrockAnthropic / ClaudeCLI ToolCachingClaudeEvalsForkedLarge Language ModelsNode.jsOllamaOpen SourceOpenAIPromptFooRed TeamingSecurityTutorial
Taxonomy
category
Deployment Context
Industries
Modalities
Skill Areas
tag
Recent Activity
Updated 2 months ago
7 Days
0
30 Days
0
90 Days
20
docs(site): refresh red team report screenshots (#8125)
Ian Webster • Mar 13, 2026
fix(redteam): fix Rules of Hooks violation in RiskCategoryDrawer (#8072)
Evan Bonsignori • Mar 12, 2026
feat(app): add manual filtering to DataTable and improve filter UX (#8122)
Faizan Minhas • Mar 12, 2026
Quality
production- Quality
- high
- Maturity
- production
Categories
Evals & BenchmarkingPrimaryInference & ServingDev Tools & AutomationLearning ResourcesSecurity & SafetyFoundation ModelsOther AI / ML
PM Skills
Cost & EfficiencySafety & AlignmentData & EvaluationDeveloper Platform
Languages
TypeScript100.0%
Timeline
- Project created
- Apr 28, 2023
- Forked
- Mar 13, 2026
- Your last push
- 2 months ago
- Upstream last push
- 15 days ago
- Tracked since
- Mar 13, 2026
Similar Repos
pgvector cosine similarity · $0
Loading…