Library/llamaForked

meta-llama/llama

llama

Inference code for Llama models

Builder

Meta

Meta

meta-llama • big-tech

Stars

59,292

Using upstream star count

Forks

9,828

Using upstream fork count

Open Issues

0

Activity Score

0/100

0 commits in 30d

Created

Feb 14, 2023

Project creation date

README Summary

This repository contains the official inference code for Meta's Llama large language models. It provides tools and utilities for running inference on various Llama model variants including text generation capabilities. The codebase is designed to enable efficient deployment and usage of Llama models for natural language processing tasks.

AI Dev Skills

Unmapped

Large Language Model InferenceTransformer ArchitectureNatural Language ProcessingModel OptimizationGPU ComputingPyTorch Implementation

Tags

Large Language Model InferenceTransformer ArchitectureNatural Language ProcessingModel OptimizationGPU ComputingPyTorch ImplementationLarge Language ModelsConversational AIPython ML EngineeringLocal AI InferenceCustom LLM DeploymentDeep Learning DeploymentText GenerationLocal InferenceSelf-hosted AIResearch ExperimentationSelf-hostedOpen Source AIOn-premiseTextLocal DevelopmentPython

Taxonomy

Recent Activity

Updated 1 years ago

7 Days

0

30 Days

0

90 Days

0

Quality

beta
Quality
medium
Maturity
beta

Categories

Learning ResourcesPrimaryInference & ServingNLP & TextSearch & KnowledgeOther AI / MLFoundation ModelsModel Training

PM Skills

Product Discovery

Languages

Python100.0%

Timeline

Project created
Feb 14, 2023
Forked
Mar 22, 2026
Your last push
1 years ago
Upstream last push
1 years ago
Tracked since
Jan 26, 2025

Similar Repos

pgvector cosine similarity · $0

Loading…