Library/LocalAI
Library/LocalAIForked

mudler/LocalAI

LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more. Features: Generate Text, MCP, Audio, Video, Images, Voice Cloning, Distributed, P2P and decentralized inference

Builder

mudler

mudler

mudler • individual

Stars

44,801

Using upstream star count

Forks

3,846

Using upstream fork count

Open Issues

0

Activity Score

0/100

169 commits in 30d

Created

Mar 18, 2023

Project creation date

README Summary

LocalAI is a free, open-source alternative to OpenAI and Claude that runs locally on consumer-grade hardware without requiring a GPU. It serves as a drop-in replacement for OpenAI's API while supporting multiple model formats including gguf, transformers, and diffusers. The platform enables text generation, audio/video processing, image creation, voice cloning, and supports distributed P2P inference.

AI Dev Skills

Unmapped

Large Language Model DeploymentMulti-Modal AI SystemsModel Format ConversionDistributed InferenceVoice CloningText-to-SpeechText-to-Image GenerationVideo GenerationP2P Distributed ComputingAPI Gateway DesignHardware OptimizationModel Serving Architecture

Tags

Large Language Model DeploymentMulti-Modal AI SystemsModel Format ConversionDistributed InferenceVoice CloningText-to-SpeechText-to-Image GenerationVideo GenerationP2P Distributed ComputingAPI Gateway DesignHardware OptimizationModel Serving ArchitectureLocal-First AISelf-Hosted AI InfrastructureLocal Code CompletionEdge AIAudio TranscriptionAudioCustom AI Model HostingP2P DistributedEdge/MobilePrivacy-First AI ApplicationsMultimodalOpen Source AIImage GenerationOn-premisePrivacy-Preserving AIText GenerationTextSelf-hostedVideoImageVideo Content CreationOn-device AIOffline AI InferenceDecentralized AIPrivate AI Assistant DeploymentGoMCP

Taxonomy

Recent Activity

Updated 27 days ago

7 Days

19

30 Days

169

90 Days

610

Quality

production
Quality
high
Maturity
production

Categories

MLOps & InfrastructurePrimaryDev Tools & AutomationLearning ResourcesInference & ServingML Platform & InfrastructureCoding & Dev ToolsMultimodal AIEdge & Mobile AIOther AI / MLFoundation ModelsAI AgentsGenerative Media

PM Skills

Scale & ReliabilityDeveloper Platform

Languages

Go100.0%

Timeline

Project created
Mar 18, 2023
Forked
Mar 16, 2026
Your last push
27 days ago
Upstream last push
7 days ago
Tracked since
Mar 17, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…