Reporium
GraphWikiTaxonomyStacksInsightsTrendsArchitectureAI-NativeFAQ
Ask anything about the repo library…
Loading repo…
←Library/DeepSpeed
Library/DeepSpeedForked

deepspeedai/DeepSpeed

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

View on GitHub↗Upstream deepspeedai/DeepSpeed↗

Builder

deepspeedai

deepspeedai

deepspeedai • individual

Stars

42,406

Using upstream star count

Forks

4,841

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Jan 23, 2020

Project creation date

README Summary

[![License Apache 2.0](https://badgen.net/badge/license/apache2.0/blue)](https://github.com/deepspeedai/DeepSpeed/blob/master/LICENSE) [![PyPI version](https://badge.fury.io/py/deepspeed.svg)](https://pypi.org/project/deepspeed/) [![Downloads](https://static.pepy.tech/badge/deepspeed)](https://pepy.tech/project/deepspeed) [![Build](https://badgen.net/badge/build/check-status/blue)](#build-pipeline-status) [![OpenSSF Best Practices](https://www.bestpractices.dev/projects/9530/badge)](https://www.

Community Evaluation

Loading…

AI Dev Skills

Unmapped

Data ParallelismDistributed Deep LearningDistributed SystemsGPU Memory ManagementGradient CompressionHigh Performance ComputingLarge Language Model TrainingMemory OptimizationMixed Precision TrainingModel ParallelismNeural Network OptimizationPipeline ParallelismScalable Machine LearningTransformer ArchitectureZero Redundancy Optimizer

Tags

Data ParallelismDistributed Deep LearningDistributed SystemsGPU Memory ManagementGradient CompressionHigh Performance ComputingLarge Language Model TrainingMemory OptimizationMixed Precision TrainingModel ParallelismNeural Network OptimizationPipeline ParallelismScalable Machine LearningTransformer ArchitectureZero Redundancy OptimizerC++Deep LearningDeepSpeedDistillationForkedGPU / CUDAHuggingFaceLarge Language ModelsLong ContextMLOpsMusic TechOpen SourceOpenAIPyTorchPythonQuantizationRLHFReinforcement LearningResearch / PapersTransformersTutorial

Taxonomy

AI Trends

Large Language ModelsEfficient AI TrainingDistributed AI SystemsModel OptimizationScalable AI Infrastructure

category

Foundation ModelsModel TrainingInference & ServingMLOps & InfrastructureLearning ResourcesIndustry: Audio & Music

Deployment Context

CloudOn-premiseMulti-GPU ClustersDistributed Computing

Modalities

TextMultimodal

Skill Areas

Distributed Deep LearningModel ParallelismData ParallelismPipeline ParallelismMemory OptimizationGradient CompressionMixed Precision TrainingZero Redundancy OptimizerLarge Language Model TrainingTransformer ArchitectureGPU Memory ManagementDistributed SystemsHigh Performance ComputingNeural Network OptimizationScalable Machine Learning

tag

C++Deep LearningDeepSpeedDistillationForkedGPU / CUDAHuggingFaceLarge Language ModelsLong ContextMLOpsMusic TechOpen SourceOpenAIPyTorchPythonQuantizationRLHFReinforcement LearningResearch / PapersTransformersTutorial

Use Cases

Large Language Model TrainingDistributed Neural Network TrainingMemory-Efficient Model Fine-tuningScalable Deep Learning InferenceMulti-GPU Model TrainingLarge-Scale Transformer TrainingEfficient Model Serving

Recent Activity

Updated 2 months ago

7 Days

0

30 Days

0

90 Days

11

Update version (#7903)

Logan Adams • Mar 13, 2026

5f7b687

fix(zero3): use current_stream() instead of default_stream() for grad… (#7898)

Michael Royzen • Mar 13, 2026

be60451

Add AGENTS.md and CLAUDE.md with project rules for AI coding agents (#7902)

Ma, Guokai • Mar 13, 2026

49a82a0

Quality

production
Quality
high
Maturity
production

Categories

Foundation ModelsPrimaryModel TrainingInference & ServingGenerative MediaML Platform & InfrastructureSearch & KnowledgeOther AI / MLMLOps & InfrastructureLearning ResourcesIndustry: Audio & Music

PM Skills

Cost & EfficiencyScale & Reliability

Languages

Python100.0%

Timeline

Project created
Jan 23, 2020
Forked
Mar 22, 2026
Your last push
2 months ago
Upstream last push
17 days ago
Tracked since
Mar 22, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…