mudler/LocalAI
LocalAI
:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference
Builder
mudler
mudler • individual
Stars
46,537
Using upstream star count
Forks
4,114
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Mar 18, 2023
Project creation date
README Summary
<h1 align="center"> <br> <img width="300" src="./core/http/static/logo.png"> <br> <br> </h1>
Community Evaluation
Loading…AI Dev Skills
Unmapped
API Gateway DesignDistributed InferenceHardware OptimizationLarge Language Model DeploymentModel Format ConversionModel Serving ArchitectureMulti-Modal AI SystemsP2P Distributed ComputingText-to-Image GenerationText-to-SpeechVideo GenerationVoice Cloning
Tags
API Gateway DesignDistributed InferenceHardware OptimizationLarge Language Model DeploymentModel Format ConversionModel Serving ArchitectureMulti-Modal AI SystemsP2P Distributed ComputingText-to-Image GenerationText-to-SpeechVideo GenerationVoice CloningAI AgentsAPIAWSAnthropic / ClaudeBackendC++ChromaComputer VisionDatabaseDockerEmbeddingsFine-TuningFlowiseForkedGPT4AllGPU / CUDAGemmaGoHuggingFaceImage GenerationKubernetesLLM ServingLangChainLarge Language ModelsMCPMultimodal AIMusic / Audio AIMusic TechOllamaOpen SourceOpenAIPythonQuantizationQwenReact / Next.jsReal-Time / StreamingRerankingRoadmapSpeech to TextStable DiffusionText to SpeechTool UseTransformersTutorialVector DatabaseWhisperllama.cppvLLM
Taxonomy
AI Trends
category
Deployment Context
Modalities
Skill Areas
tag
AI AgentsAPIAWSAnthropic / ClaudeBackendC++ChromaComputer VisionDatabaseDockerEmbeddingsFine-TuningFlowiseForkedGPT4AllGPU / CUDAGemmaGoHuggingFaceImage GenerationKubernetesLLM ServingLangChainLarge Language ModelsMCPMultimodal AIMusic / Audio AIMusic TechOllamaOpen SourceOpenAIPythonQuantizationQwenReact / Next.jsReal-Time / StreamingRerankingRoadmapSpeech to TextStable DiffusionText to SpeechTool UseTransformersTutorialVector DatabaseVideo GenerationWhisperllama.cppvLLM
Recent Activity
Updated 2 months ago
7 Days
0
30 Days
0
90 Days
20
chore: refactor endpoints to use same inferencing path, add automatic retrial mechanism in case of e
Ettore Di Giacinto • Mar 16, 2026
fix(ui): Add tracing inline settings back and create UI tests (#9027)
Richard Palethorpe • Mar 16, 2026
fix(api): unescape model names (#9024)
Ettore Di Giacinto • Mar 15, 2026
Quality
production- Quality
- high
- Maturity
- production
Categories
RAG & RetrievalPrimaryInference & ServingMLOps & InfrastructureDev Tools & AutomationCloud & PlatformsLearning ResourcesIndustry: Audio & MusicFoundation ModelsAI AgentsModel TrainingGenerative MediaComputer VisionCoding & Dev ToolsMultimodal AIOther AI / ML
PM Skills
Cost & EfficiencyUser ExperienceScale & ReliabilityProduct DiscoveryDeveloper PlatformAI-Native Architecture
Languages
Go100.0%
Timeline
- Project created
- Mar 18, 2023
- Forked
- Mar 16, 2026
- Your last push
- 2 months ago
- Upstream last push
- 16 days ago
- Tracked since
- Mar 17, 2026
Similar Repos
pgvector cosine similarity · $0
Loading…