bitsandbytes-foundation/bitsandbytes
bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
Builder
bitsandbytes-foundation
bitsandbytes-foundation • individual
Stars
8,095
Using upstream star count
Forks
842
Using upstream fork count
Open Issues
0
Activity Score
0/100
0 commits in 30d
Created
Jun 4, 2021
Project creation date
README Summary
BitsAndBytes is a lightweight Python library that enables efficient quantization techniques for PyTorch models, particularly focusing on k-bit quantization to reduce memory usage of large language models. The library provides optimized CUDA kernels for quantized operations and supports various quantization schemes including 8-bit and 4-bit precision. It allows researchers and practitioners to run large models on consumer hardware by significantly reducing memory requirements while maintaining model performance.
AI Dev Skills
Unmapped
Tags
Taxonomy
Deployment Context
Modalities
Skill Areas
Recent Activity
Updated 27 days ago
7 Days
0
30 Days
0
90 Days
0
Quality
production- Quality
- high
- Maturity
- production
Categories
PM Skills
Languages
Timeline
- Project created
- Jun 4, 2021
- Forked
- Mar 22, 2026
- Your last push
- 27 days ago
- Upstream last push
- 8 days ago
- Tracked since
- Mar 17, 2026
Similar Repos
pgvector cosine similarity · $0
Loading…