Library/ggmlForked

ggml-org/ggml

ggml

Tensor library for machine learning

Builder

ggml-org

ggml-org

ggml-org • individual

Stars

14,340

Using upstream star count

Forks

1,532

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Sep 18, 2022

Project creation date

README Summary

GGML is a tensor library for machine learning written in C that focuses on efficient inference of large language models on commodity hardware. It provides optimized implementations for various CPU architectures and supports quantization techniques to reduce memory usage while maintaining model performance. The library is designed to be lightweight and portable, enabling deployment of ML models on resource-constrained devices.

AI Dev Skills

Unmapped

Tensor OperationsCPU OptimizationLow-level Machine LearningMemory ManagementSIMD ProgrammingCross-platform DevelopmentPerformance EngineeringQuantization TechniquesHardware AccelerationNumerical Computing

Tags

Tensor OperationsCPU OptimizationLow-level Machine LearningMemory ManagementSIMD ProgrammingCross-platform DevelopmentPerformance EngineeringQuantization TechniquesHardware AccelerationNumerical ComputingHardware OptimizationLarge Language Model InferenceCross-platformEdge/MobileCross-platform ML InferenceResource-constrained AI SystemsOn-device AITextModel QuantizationEfficient InferenceCPU-based Model DeploymentAudioSelf-hostedEdge ComputingOn-device AI ApplicationsOn-premiseC++

Taxonomy

Recent Activity

Updated 1 months ago

7 Days

0

30 Days

0

90 Days

0

Quality

production
Quality
high
Maturity
production

Categories

ML Platform & InfrastructurePrimaryEdge & Mobile AIOther AI / MLDev Tools & AutomationInference & ServingFoundation ModelsGenerative MediaRobotics

PM Skills

Developer Platform

Languages

C++100.0%

Timeline

Project created
Sep 18, 2022
Forked
Mar 13, 2026
Your last push
1 months ago
Upstream last push
11 days ago
Tracked since
Feb 27, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…