Reporium
GraphWikiTaxonomyStacksInsightsTrendsArchitectureAI-NativeFAQ
Ask anything about the repo library…
Loading repo…
←Library/litgpt
Library/litgptForked

Lightning-AI/litgpt

litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

View on GitHub↗Upstream Lightning-AI/litgpt↗

Builder

Lightning-AI

Lightning-AI

Lightning-AI • individual

Stars

13,390

Using upstream star count

Forks

1,446

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

May 4, 2023

Project creation date

README Summary

**20+ high-performance LLMs with recipes to pretrain, finetune, and deploy at scale.**

Community Evaluation

Loading…

AI Dev Skills

Unmapped

Distributed TrainingGPU Memory OptimizationLarge Language Model TrainingLoRA Fine-tuningModel CompressionModel OptimizationModel QuantizationModel Serving and DeploymentParameter-Efficient Fine-tuningPyTorch Lightning FrameworkQLoRA Fine-tuningRLHF (Reinforcement Learning from Human Feedback)Transformer Architecture Implementation

Tags

Distributed TrainingGPU Memory OptimizationLarge Language Model TrainingLoRA Fine-tuningModel CompressionModel OptimizationModel QuantizationModel Serving and DeploymentParameter-Efficient Fine-tuningPyTorch Lightning FrameworkQLoRA Fine-tuningRLHF (Reinforcement Learning from Human Feedback)Transformer Architecture ImplementationAWSCLI ToolCourseDeepSeekEmbeddingsEvalsFSDPFine-TuningForkedGemmaHuggingFaceLM Eval HarnessLarge Language ModelsLlamaLoRA / PEFTLong ContextMMLUMistralMobileOpenAIPyTorchPythonQuantizationQwenResearch / PapersTool UseTransformersTutorialWeights & Biases

Taxonomy

AI Trends

Large Language ModelsParameter-Efficient Fine-tuningModel QuantizationOpen Source LLMsEfficient AI TrainingOn-device AI

category

Foundation ModelsAI AgentsRAG & RetrievalModel TrainingEvals & BenchmarkingObservability & MonitoringDev Tools & AutomationCloud & PlatformsLearning Resources

Deployment Context

CloudSelf-hostedOn-premiseEdge

Modalities

Text

Skill Areas

Large Language Model TrainingTransformer Architecture ImplementationLoRA Fine-tuningQLoRA Fine-tuningModel QuantizationDistributed TrainingParameter-Efficient Fine-tuningModel OptimizationRLHF (Reinforcement Learning from Human Feedback)Model CompressionGPU Memory OptimizationPyTorch Lightning FrameworkModel Serving and Deployment

tag

AWSCLI ToolCourseDeepSeekEmbeddingsEvalsFSDPFine-TuningForkedGemmaHuggingFaceLM Eval HarnessLarge Language ModelsLlamaLoRA / PEFTLong ContextMMLUMistralMobileOpenAIPyTorchPythonQuantizationQwenResearch / PapersTool UseTransformersTutorialWeights & Biases

Use Cases

Large Language Model PretrainingCustom LLM Fine-tuningModel Adaptation for Specific DomainsEfficient Model DeploymentResearch and Experimentation with LLMsProduction LLM ServingModel Performance Optimization

Recent Activity

Updated 2 months ago

7 Days

0

30 Days

0

90 Days

3

fix: handle empty prompt list in R1Base.apply() (#2216)

LincolnBurrows2017 • Mar 21, 2026

7a548b9

Add YaRN rope adjustment + DeepSeekV3 rope_interleave (#2202)

SJ Yu • Mar 19, 2026

162ad9b

chore(workflows): Sync GPU CI workflow image with lightning-thunder repo (#2208)

Bhimraj Yadav • Mar 4, 2026

3779510

Quality

production
Quality
high
Maturity
production

Categories

RAG & RetrievalPrimaryEvals & BenchmarkingObservability & MonitoringDev Tools & AutomationCloud & PlatformsLearning ResourcesFoundation ModelsAI AgentsModel TrainingSafety & AlignmentEdge & Mobile AISearch & KnowledgeOther AI / ML

PM Skills

Cost & EfficiencyData & EvaluationProduct DiscoveryDeveloper Platform

Languages

Python100.0%

Timeline

Project created
May 4, 2023
Forked
Mar 23, 2026
Your last push
2 months ago
Upstream last push
1 months ago
Tracked since
Mar 22, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…