mlc-ai/mlc-llm
mlc-llm
Universal LLM Deployment Engine with ML Compilation
Builder
mlc-ai
mlc-ai • individual
Stars
22,314
Using upstream star count
Forks
1,984
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Apr 29, 2023
Project creation date
README Summary
MLC LLM is a universal deployment solution that enables native deployment of large language models with compiler acceleration. It allows LLMs to run efficiently on diverse hardware backends including consumer GPUs, web browsers, and mobile devices through machine learning compilation techniques. The project provides a complete workflow from model optimization to deployment across different platforms.
AI Dev Skills
Unmapped
Tags
Taxonomy
Deployment Context
Modalities
Skill Areas
Recent Activity
Updated 27 days ago
7 Days
0
30 Days
0
90 Days
0
Quality
beta- Quality
- high
- Maturity
- beta
Categories
PM Skills
Languages
Timeline
- Project created
- Apr 29, 2023
- Forked
- Mar 22, 2026
- Your last push
- 27 days ago
- Upstream last push
- 7 days ago
- Tracked since
- Mar 18, 2026
Similar Repos
pgvector cosine similarity · $0
Loading…