Reporium
GraphWikiTaxonomyStacksInsightsTrendsArchitectureAI-NativeFAQ
Ask anything about the repo library…
Loading repo…
←Library/dalai
Library/dalaiForked

cocktailpeanut/dalai

dalai

The simplest way to run LLaMA on your local machine

View on GitHub↗Upstream cocktailpeanut/dalai↗

Builder

cocktailpeanut

cocktailpeanut

cocktailpeanut • individual

Stars

12,930

Using upstream star count

Forks

1,338

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Mar 12, 2023

Project creation date

README Summary

<a href="https://github.com/cocktailpeanut/dalai" class='inverse btn'><i class="fa-brands fa-github"></i> GitHub</a> <a href="https://twitter.com/cocktailpeanut" class='inverse btn'><i class="fa-brands fa-twitter"></i> Twitter</a> <a href="https://discord.gg/WWfgrzzkCT" class='inverse btn'><i class="fa-brands fa-discord"></i> Discord</a>

Community Evaluation

Loading…

AI Dev Skills

Unmapped

Hardware OptimizationLarge Language Model DeploymentLLaMA ArchitectureLocal Model InferenceModel Quantization

Tags

Hardware OptimizationLarge Language Model DeploymentLLaMA ArchitectureLocal Model InferenceModel QuantizationC++DockerForkedHuggingFaceJavaScriptNode.jsPyTorchPythonQuantizationReal-Time / Streamingllama.cpp

Taxonomy

AI Trends

On-device AILocal AIOpen Source Language ModelsDemocratized AI Access

category

Foundation ModelsModel TrainingInference & ServingMLOps & InfrastructureDev Tools & Automation

Deployment Context

Self-hostedLocal MachineOn-premise

Industries

Developer ToolsEducationResearch

Modalities

Text

Skill Areas

Large Language Model DeploymentLocal Model InferenceLLaMA ArchitectureModel QuantizationHardware Optimization

tag

C++DockerForkedHuggingFaceJavaScriptNode.jsPyTorchPythonQuantizationReal-Time / Streamingllama.cpp

Use Cases

Local AI ExperimentationOffline Text GenerationPrivacy-Preserving Language ProcessingEducational AI LearningResearch Prototyping

Recent Activity

Updated 1 years ago

7 Days

0

30 Days

0

90 Days

0

Quality

prototype
Quality
medium
Maturity
prototype

Categories

Inference & ServingPrimaryMLOps & InfrastructureDev Tools & AutomationFoundation ModelsModel Training

PM Skills

Cost & EfficiencyScale & Reliability

Languages

CSS100.0%

Timeline

Project created
Mar 12, 2023
Forked
Mar 23, 2026
Your last push
1 years ago
Upstream last push
1 years ago
Tracked since
Jun 18, 2024

Similar Repos

pgvector cosine similarity · $0

Loading…