airllm
AirLLM runs 70B large language models on a single 4GB GPU without quantization, distillation or pruning. Kimi K3 2.8T on under 4GB, Qwen3.8-Flash-Next 125B on 6GB, DeepSeek-V3 671B on ~12GB. Train Qwen3.8-Flash-Next under 6GB.
airllm has been downloaded 303,483 times in total on PyPI, including 10,922 in the last 30 days. The latest version is 4.0.0, released Sep 5, 2026.
Version4.0.0
Downloads
303.48k
License—
AuthorGavin Li
UpdatedSep 5, 2026
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal4.*3.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included3 / 40 series
Selected total80.34k
303.5kAll-time
10.9kLast 30 days
623Last 24 h
<0.01/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0132.5%
3.1.0
14.5k downloadsDownloads14.5k32.5% - 0226.6%
4.0.0
11.9k downloadsDownloads11.9k26.6% - 039.4%
3.2.0
4.2k downloadsDownloads4.2k9.4% - 045.3%
3.3.0
2.4k downloadsDownloads2.4k5.3% - 054.0%
3.0.1
1.8k downloadsDownloads1.8k4.0% - 063.5%
2.11.0
1.6k downloadsDownloads1.6k3.5% - 071.1%
3.0.0
498 downloadsDownloads4981.1% - 080.7%
2.8.3
300 downloadsDownloads3000.7% - 0916.8%
Other
7.5k downloadsDownloads7.5k16.8%
Guess the next day
Thirteen recent days of airllm downloads. Drag the green handle on the right to guess where day fourteen lands.