GoogleCloudPlatform/localllm
localllm
- Quantized models from 🤗 - [llama-cpp-python's webserver][web-server]
Builder
GoogleCloudPlatform
GoogleCloudPlatform • individual
Stars
1,550
Using upstream star count
Forks
119
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Nov 29, 2023
Project creation date
README Summary
- Quantized models from 🤗 - [llama-cpp-python's webserver][web-server]
Community Evaluation
Loading…AI Dev Skills
Unmapped
Language Model InferenceLocal Model DeploymentModel Serving Infrastructure
Tags
Language Model InferenceLocal Model DeploymentModel Serving InfrastructureAPIC++DockerForkedGoogle CloudHuggingFaceLarge Language ModelsOpenAIPythonQuantization
Taxonomy
Deployment Context
Modalities
Recent Activity
Updated 2 years ago
7 Days
0
30 Days
0
90 Days
0
Quality
prototype- Quality
- low
- Maturity
- prototype
Categories
MLOps & InfrastructurePrimaryDev Tools & AutomationCloud & PlatformsFoundation ModelsOther AI / ML
PM Skills
Cost & EfficiencyDeveloper PlatformScale & Reliability
Languages
Python100.0%
Timeline
- Project created
- Nov 29, 2023
- Forked
- Mar 13, 2026
- Your last push
- 2 years ago
- Upstream last push
- 2 years ago
- Tracked since
- Apr 25, 2024
Similar Repos
pgvector cosine similarity · $0
Loading…