Library/exoForked

exo-explore/exo

exo

Run frontier AI locally.

Builder

exo-explore

exo-explore

exo-explore • individual

Stars

43,266

Using upstream star count

Forks

2,983

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Jun 24, 2024

Project creation date

README Summary

Exo is a system for running large language models locally across multiple devices by dynamically partitioning models and distributing inference across your available hardware. It supports popular models like LLaMA, Mistral, and others while providing a ChatGPT-compatible API for easy integration. The system automatically discovers and coordinates compute resources across different devices to enable running models that wouldn't fit on a single machine.

AI Dev Skills

Unmapped

Large Language Model InferenceDistributed ComputingModel QuantizationGPU AccelerationAPI DevelopmentPeer-to-Peer NetworkingModel OptimizationCross-platform Deployment

Tags

Large Language Model InferenceDistributed ComputingModel QuantizationGPU AccelerationAPI DevelopmentPeer-to-Peer NetworkingModel OptimizationCross-platform DeploymentResource ManagementMulti-Device Model ExecutionNetwork Protocol DesignPrivacy-Preserving AI InferenceTextLocal AI Model HostingDistributed AI Model InferenceLarge Language Model DeploymentEdge/MobilePrivacy-Preserving AIModel PartitioningResource Pooling for AI WorkloadsOn-premiseSelf-hostedDistributed AI SystemsModel Inference OptimizationOn-device AILocal AI InfrastructurePython

Taxonomy

Recent Activity

Updated 23 days ago

7 Days

0

30 Days

0

90 Days

0

Quality

beta
Quality
high
Maturity
beta

Categories

MLOps & InfrastructurePrimaryDev Tools & AutomationInference & ServingML Platform & InfrastructureEdge & Mobile AIOther AI / MLFoundation ModelsRobotics

PM Skills

Scale & ReliabilityDeveloper Platform

Languages

Python100.0%

Timeline

Project created
Jun 24, 2024
Forked
Mar 22, 2026
Your last push
23 days ago
Upstream last push
7 days ago
Tracked since
Mar 21, 2026

Similar Repos

pgvector cosine similarity · $0

Loading…