mistralai/mistral-inference
mistral-inference
Official inference library for Mistral models
Builder
Mistral AI
mistralai • ai-lab
Stars
10,808
Using upstream star count
Forks
1,050
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Sep 27, 2023
Project creation date
README Summary
Mistral Inference <a target="_blank" href="https://colab.research.google.com/github/mistralai/mistral-inference/blob/main/tutorials/getting_started.ipynb"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>
Community Evaluation
Loading…AI Dev Skills
Unmapped
Distributed InferenceFunction CallingGPU AccelerationLarge Language Model InferenceModel OptimizationModel ServingText GenerationTransformer Architecture
Tags
Distributed InferenceFunction CallingGPU AccelerationLarge Language Model InferenceModel OptimizationModel ServingText GenerationTransformer ArchitectureCLI ToolDockerForkedHuggingFaceJupyterLLM ServingLoRA / PEFTMistralMultimodal AIPythonResearch / PapersRustTool UseTransformersvLLM
Taxonomy
category
Deployment Context
Modalities
Skill Areas
tag
Recent Activity
Updated 3 months ago
7 Days
0
30 Days
0
90 Days
0
Quality
production- Quality
- high
- Maturity
- production
Categories
Inference & ServingPrimaryMLOps & InfrastructureDev Tools & AutomationLearning ResourcesData Science & AnalyticsFoundation ModelsAI AgentsModel TrainingMultimodal AISearch & KnowledgeOther AI / ML
PM Skills
Cost & EfficiencyUser ExperienceScale & ReliabilityDeveloper Platform
Languages
Jupyter Notebook100.0%
Timeline
- Project created
- Sep 27, 2023
- Forked
- Mar 14, 2026
- Your last push
- 3 months ago
- Upstream last push
- 1 months ago
- Tracked since
- Feb 26, 2026
Similar Repos
pgvector cosine similarity · $0
Loading…