EthicalML/awesome-production-machine-learning
awesome-production-machine-learning
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
Builder
EthicalML
EthicalML • individual
Stars
20,783
Using upstream star count
Forks
2,593
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Aug 15, 2018
Project creation date
README Summary
[](https://awesome.re) [](https://twitter.com/EthicalML)
Community Evaluation
Loading…AI Dev Skills
Unmapped
A/B Testing for MLAutoML and Hyperparameter OptimizationContinuous Integration/Continuous Deployment for MLData Labeling and ManagementDistributed TrainingFeature Store ManagementML Model DeploymentML Model GovernanceML Operations (MLOps)ML Pipeline OrchestrationModel Monitoring and ObservabilityModel Serving and InferenceModel Versioning and Management
Tags
A/B Testing for MLAutoML and Hyperparameter OptimizationContinuous Integration/Continuous Deployment for MLData Labeling and ManagementDistributed TrainingFeature Store ManagementML Model DeploymentML Model GovernanceML Operations (MLOps)ML Pipeline OrchestrationModel Monitoring and ObservabilityModel Serving and InferenceModel Versioning and ManagementAI AgentsAI SafetyAPIAWS BedrockAdversarialAirflowAnthropic / ClaudeAutomationAxolotlAzure AIBatchingBenchmarkingC++CLI ToolCachingChromaClaudeComputer VisionCurated ListDSPyDVCData EngineeringData ScienceData VisualizationDatabaseDeep LearningDeepEvalDeepSeekDeepSpeedDistillationDockerDocument ProcessingEmbeddingsEvalsFeature StoreFinTechFine-TuningForkedGPTGPU / CUDAGRPOGemmaGoogle CloudGraphQLGraphRAGGraspingHaystackHealthcare AIHeliconeHuggingFaceHumanEvalHybrid SearchInferenceJAXKerasKnowledge GraphKubeflowKubernetesLLM ServingLM Eval HarnessLangChainLangfuseLarge Language ModelsLiteLLMLlamaLlamaIndexLoRA / PEFTMLOpsMLflowMachine LearningMem0MilvusMobileModel OptimizationMulti-AgentMultimodal AIMusic TechNeMo GuardrailsNode.jsNumPyONNXOllamaOpen SourceOpen WebUIOpenAIOpenLITOpenLLMetryPandasPhiPhoenixPoint Cloud / 3D VisionPrefectPrivacyPrivacy-Preserving AIPrompt EngineeringPrompt InjectionPromptFooPyTorchPythonPython Web FrameworkQdrantQuantizationQwenRAGRAGASRLHFReact / Next.jsReal-Time / StreamingReinforcement LearningRerankingResearch / PapersRobot LearningRoboticsRustSGLangSageMakerScikit-learnSecuritySegmentationSemantic KernelSemantic SearchSimulationSparkSpeech to TextStatisticsSynthetic DataTGITRLTensorFlowTensorRTText to SpeechTorchTuneTraceloopTransformersTritonTypeScriptUnslothVector DatabaseVertex AIVisualizationWeaviateWeights & BiasesZenMLllama.cpppgvectorvLLM
Taxonomy
category
Model TrainingFoundation ModelsAI AgentsRAG & RetrievalEvals & BenchmarkingObservability & MonitoringInference & ServingGenerative MediaComputer VisionRoboticsMLOps & InfrastructureDev Tools & AutomationCloud & PlatformsLearning ResourcesIndustry: HealthcareIndustry: FinTechIndustry: Audio & MusicIndustry: GamingSecurity & SafetyData Science & Analytics
Deployment Context
Skill Areas
ML Model DeploymentML Operations (MLOps)Model Monitoring and ObservabilityModel Versioning and ManagementML Pipeline OrchestrationFeature Store ManagementA/B Testing for MLModel Serving and InferenceDistributed TrainingAutoML and Hyperparameter OptimizationData Labeling and ManagementML Model GovernanceContinuous Integration/Continuous Deployment for ML
tag
AI AgentsAI SafetyAPIAWS BedrockAdversarialAirflowAnthropic / ClaudeAutomationAxolotlAzure AIBatchingBenchmarkingC++CLI ToolCachingChromaClaudeComputer VisionCurated ListDSPyDVCData EngineeringData ScienceData VisualizationDatabaseDeep LearningDeepEvalDeepSeekDeepSpeedDistillationDockerDocument ProcessingEmbeddingsEvalsFeature StoreFinTechFine-TuningForkedGPTGPU / CUDAGRPOGemmaGoogle CloudGraphQLGraphRAGGraspingHaystackHealthcare AIHeliconeHuggingFaceHumanEvalHybrid SearchInferenceJAXKerasKnowledge GraphKubeflowKubernetesLLM ServingLM Eval HarnessLangChainLangfuseLarge Language ModelsLiteLLMLlamaLlamaIndexLoRA / PEFTMLOpsMLflowMachine LearningMem0MilvusMobileModel OptimizationMulti-AgentMultimodal AIMusic TechNeMo GuardrailsNode.jsNumPyONNXOllamaOpen SourceOpen WebUIOpenAIOpenLITOpenLLMetryPandasPhiPhoenixPoint Cloud / 3D VisionPrefectPrivacyPrivacy-Preserving AIPrompt EngineeringPrompt InjectionPromptFooPyTorchPythonPython Web FrameworkQdrantQuantizationQwenRAGRAGASRLHFReact / Next.jsReal-Time / StreamingReinforcement LearningRerankingResearch / PapersRobot LearningRoboticsRustSGLangSageMakerScikit-learnSecuritySegmentationSemantic KernelSemantic SearchSimulationSparkSpeech to TextStatisticsSynthetic DataTGITRLTensorFlowTensorRTText to SpeechTorchTuneTraceloopTransformersTritonTypeScriptUnslothVector DatabaseVertex AIVisualizationWeaviateWeights & BiasesZenMLllama.cpppgvectorvLLM
Recent Activity
Updated 4 months ago
7 Days
0
30 Days
0
90 Days
0
Quality
production- Quality
- high
- Maturity
- production
Categories
RAG & RetrievalPrimaryEvals & BenchmarkingObservability & MonitoringInference & ServingMLOps & InfrastructureDev Tools & AutomationCloud & PlatformsLearning ResourcesIndustry: HealthcareIndustry: FinTechIndustry: Audio & MusicIndustry: GamingSecurity & SafetyData Science & AnalyticsFoundation ModelsAI AgentsModel TrainingGenerative MediaComputer VisionML Platform & InfrastructureSafety & AlignmentHealthcare & BiologyFinance & LegalMultimodal AIEdge & Mobile AISearch & KnowledgeOther AI / MLRobotics
PM Skills
Cost & EfficiencySafety & AlignmentUser ExperienceScale & ReliabilityData & EvaluationProduct DiscoveryDeveloper PlatformAI-Native Architecture
Languages
No language breakdown recorded.
Timeline
- Project created
- Aug 15, 2018
- Forked
- Mar 13, 2026
- Your last push
- 4 months ago
- Upstream last push
- 2 months ago
- Tracked since
- Mar 5, 2026
Similar Repos
pgvector cosine similarity · $0
Loading…