Library/skillForked

pinchbench/skill

skill

PinchBench is a benchmarking system for evaluating LLM models as OpenClaw coding agents. Made with 🦀 by the humans at https://kilo.ai

View on GitHub↗Upstream pinchbench/skill↗

Builder

pinchbench

pinchbench • individual

Stars

906

Using upstream star count

Forks

Using upstream fork count

Open Issues

Activity Score

0/100

22 commits in 30d

Created

Feb 11, 2026

Project creation date

README Summary

PinchBench is a benchmarking system designed to evaluate Large Language Model (LLM) performance as OpenClaw coding agents. The system is built using Python and developed by the team at kilo.ai to provide standardized evaluation metrics for LLM coding capabilities.

AI Dev Skills

Unmapped

LLM Evaluation and BenchmarkingAgentic AI SystemsCode Generation ModelsModel Performance MetricsAgent-Based ArchitectureSoftware Engineering AILarge Language Model EvaluationCode Generation BenchmarkingLLM-as-Agent ArchitectureCoding Task EvaluationModel Performance MeasurementBenchmark Design and MethodologyCode Generation AssessmentPrompt EngineeringModel Comparison and AnalysisSoftware Engineering Agents

Taxonomy

AI Trends

Agentic AI LLM as Agents Code Generation Model Evaluation LLM Evaluation and Benchmarking AI Agent Frameworks Coding AI Systems LLM Evaluation Code-Generating Agents Model Benchmarking

Deployment Context

Self-hosted Cloud API

Industries

Developer Tools AI/ML Infrastructure AI Research

Modalities

Code Text

Skill Areas

LLM Evaluation and Benchmarking Agentic AI Systems Code Generation Models Model Performance Metrics Agent-Based Architecture Software Engineering AI Large Language Model Evaluation Code Generation Benchmarking LLM-as-Agent Architecture Coding Task Evaluation Model Performance Measurement Benchmark Design and Methodology Code Generation Assessment Prompt Engineering Model Comparison and Analysis Software Engineering Agents

Use Cases

LLM Coding Agent Benchmarking Autonomous Code Generation Evaluation Model Comparison and Selection Agent Performance Measurement LLM coding agent performance evaluation Model comparison and ranking Code generation quality assessment Automated programming task benchmarking LLM Model Evaluation Coding Agent Performance Comparison Code Generation Quality Assessment Agent Capability Benchmarking

Recent Activity

Updated 20 days ago

7 Days

30 Days

90 Days

106

Quality

prototype

Quality: medium
Maturity: prototype

PM Skills

Developer Platform

Languages

Python100.0%

Timeline

Project created: Feb 11, 2026
Forked: Mar 28, 2026
Your last push: 20 days ago
Upstream last push: 7 days ago
Tracked since: Mar 24, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…