Reporium
GraphWikiTaxonomyStacksInsightsTrendsArchitectureAI-NativeFAQ
Ask anything about the repo library…
Loading repo…
←Library/langkit
Library/langkitForked

whylabs/langkit

langkit

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀

View on GitHub↗Upstream whylabs/langkit↗

Builder

whylabs

whylabs

whylabs • individual

Stars

990

Using upstream star count

Forks

75

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Apr 26, 2023

Project creation date

README Summary

LangKit is an open-source text metrics toolkit for monitoring language models. It offers an array of methods for extracting relevant signals from the input and/or output text, which are compatible with the open-source data logging library [whylogs](https://whylogs.readthedocs.io/en/latest).

Community Evaluation

Loading…

AI Dev Skills

Unmapped

AI SafetyLarge Language Model MonitoringLLM Safety and SecurityML OperationsModel ObservabilityNatural Language ProcessingPrompt EngineeringSentiment AnalysisText AnalyticsText Quality Assessment

Tags

AI SafetyLarge Language Model MonitoringLLM Safety and SecurityML OperationsModel ObservabilityNatural Language ProcessingPrompt EngineeringSentiment AnalysisText AnalyticsText Quality AssessmentCurated ListDocument ProcessingForkedJupyterLarge Language ModelsPrompt InjectionPythonSecurity

Taxonomy

AI Trends

AI SafetyLLM ObservabilityResponsible AIAI MonitoringMLOps for LLMs

category

Foundation ModelsRAG & RetrievalDev Tools & AutomationLearning ResourcesSecurity & SafetyData Science & Analytics

Deployment Context

Self-hostedCloudOn-premise

Industries

Developer ToolsAI/ML PlatformsEnterprise SoftwareContent ModerationConversational AI

Modalities

Text

Skill Areas

Large Language Model MonitoringNatural Language ProcessingLLM Safety and SecurityText Quality AssessmentSentiment AnalysisModel ObservabilityPrompt EngineeringML OperationsAI SafetyText Analytics

tag

Curated ListDocument ProcessingForkedJupyterLarge Language ModelsPrompt InjectionPythonSecurity

Use Cases

LLM Response Quality MonitoringPrompt Safety ValidationModel Performance TrackingContent Relevance ScoringAI Safety ComplianceLLM Deployment MonitoringText Quality AssessmentSentiment Analysis of AI Responses

Recent Activity

Updated 1 years ago

7 Days

0

30 Days

0

90 Days

0

Quality

beta
Quality
medium
Maturity
beta

Categories

RAG & RetrievalPrimaryDev Tools & AutomationLearning ResourcesSecurity & SafetyData Science & AnalyticsFoundation Models

PM Skills

Safety & AlignmentProduct Discovery

Languages

Jupyter Notebook100.0%

Timeline

Project created
Apr 26, 2023
Forked
Mar 21, 2026
Your last push
1 years ago
Upstream last push
1 years ago
Tracked since
Nov 22, 2024

Similar Repos

pgvector cosine similarity · $0

Loading…