Library/mergekit
Library/mergekitForked

arcee-ai/mergekit

mergekit

Tools for merging pretrained large language models.

Builder

arcee-ai

arcee-ai

arcee-ai • individual

Stars

6,938

Using upstream star count

Forks

682

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Aug 21, 2023

Project creation date

README Summary

Mergekit is a toolkit for merging pre-trained large language models using various algorithms and techniques. It provides command-line tools and Python APIs to combine multiple models into single unified models, supporting different merging strategies like linear interpolation, SLERP, and more advanced methods. The tool is designed to help researchers and practitioners create new models by combining the strengths of existing pre-trained models.

AI Dev Skills

Unmapped

Model Merging TechniquesLarge Language Model ArchitectureNeural Network Weight InterpolationTransformer Model OptimizationModel CompressionParameter Space AnalysisGradient-based Model FusionModel Ensemble Methods

Tags

Model Merging TechniquesLarge Language Model ArchitectureNeural Network Weight InterpolationTransformer Model OptimizationModel CompressionParameter Space AnalysisGradient-based Model FusionModel Ensemble MethodsResearch Model ExperimentationTextSmall Language ModelsModel Capability EnhancementModel Performance OptimizationOpen Source AICustom Model DevelopmentModel EfficiencyOn-premiseCreating Domain-Specialized Language ModelsDemocratized AI DevelopmentSelf-hostedKnowledge Transfer Between ModelsPythonCLI

Taxonomy

Recent Activity

Updated 27 days ago

7 Days

0

30 Days

0

90 Days

0

Quality

beta
Quality
high
Maturity
beta

Categories

Learning ResourcesPrimaryInference & ServingEdge & Mobile AISearch & KnowledgeOther AI / MLFoundation Models

PM Skills

Product Discovery

Languages

Python100.0%

Timeline

Project created
Aug 21, 2023
Forked
Mar 13, 2026
Your last push
27 days ago
Upstream last push
29 days ago
Tracked since
Mar 17, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…