danveloper/flash-moe
flash-moe
Running a big model on a small laptop
Builder
danveloper
danveloper • individual
Stars
3,984
Using upstream star count
Forks
497
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Mar 18, 2026
Project creation date
README Summary
Flash-MoE: Running a 397B Parameter Model on a Laptop
Community Evaluation
Loading…AI Dev Skills
Unmapped
Efficient InferenceMemory ManagementMixture of Experts ArchitectureMobile/Edge AI DeploymentModel Optimization
Tags
Efficient InferenceMemory ManagementMixture of Experts ArchitectureMobile/Edge AI DeploymentModel OptimizationBenchmarkingCachingEvalsForkedInferenceLarge Language ModelsPythonQuantizationReal-Time / StreamingSpeculative DecodingTool UseTransformers
Taxonomy
Deployment Context
Modalities
Skill Areas
tag
Recent Activity
Updated 4 months ago
7 Days
0
30 Days
0
90 Days
0
Quality
research- Quality
- low
- Maturity
- research
Categories
Foundation ModelsPrimaryAI AgentsEvals & BenchmarkingInference & Serving
PM Skills
Cost & EfficiencyScale & ReliabilityData & EvaluationDeveloper Platform
Languages
Objective-C100.0%
Timeline
- Project created
- Mar 18, 2026
- Forked
- Mar 23, 2026
- Your last push
- 4 months ago
- Upstream last push
- 4 months ago
- Tracked since
- Mar 19, 2026
Similar Repos
pgvector cosine similarity · $0
Loading…