Library/langkitForked

whylabs/langkit

langkit

πŸ” LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). πŸ“š Extracts signals from prompts & responses, ensuring safety & security. πŸ›‘οΈ Features include text quality, relevance metrics, & sentiment analysis. πŸ“Š A comprehensive tool for LLM observability. πŸ‘€

Builder

whylabs

whylabs

whylabs β€’ individual

Stars

980

Using upstream star count

Forks

71

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Apr 26, 2023

Project creation date

README Summary

LangKit is an open-source toolkit designed for monitoring and observability of Large Language Models (LLMs). It extracts various signals from prompts and responses to ensure safety, security, and quality through metrics like text quality, relevance, and sentiment analysis. The toolkit provides comprehensive monitoring capabilities for LLM applications in production environments.

AI Dev Skills

Unmapped

Large Language Model MonitoringNatural Language ProcessingLLM Safety and SecurityText Quality AssessmentSentiment AnalysisModel ObservabilityPrompt EngineeringML OperationsAI SafetyText Analytics

Tags

Large Language Model MonitoringNatural Language ProcessingLLM Safety and SecurityText Quality AssessmentSentiment AnalysisModel ObservabilityPrompt EngineeringML OperationsAI SafetyText AnalyticsAI Safety AnalysisLLM ObservabilityAI Safety CompliancePrompt Engineering AnalysisSelf-hostedCloud APILLM Response Quality AnalysisAI/ML PlatformDeveloper ToolsEnterprise SoftwareAI MonitoringAI Model Performance TrackingLLM Application MonitoringLLM Security EvaluationNatural Language Processing MetricsOn-premiseResponsible AIContent Moderation for AI SystemsPrompt Security AssessmentTextJupyter Notebook

Taxonomy

Recent Activity

Updated 1 years ago

7 Days

0

30 Days

0

90 Days

0

Quality

beta
Quality
medium
Maturity
beta

Categories

ML Platform & InfrastructurePrimaryDev Tools & AutomationEvals & BenchmarkingObservability & MonitoringNLP & TextSafety & AlignmentData Science & AnalyticsFinance & LegalOther AI / MLFoundation ModelsAI Agents

PM Skills

Developer Platform

Languages

Jupyter Notebook100.0%

Timeline

Project created
Apr 26, 2023
Forked
Mar 21, 2026
Your last push
1 years ago
Upstream last push
1 years ago
Tracked since
Nov 22, 2024

Similar Repos

pgvector cosine similarity Β· $0

Loading…