lmcache
A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
lmcache has been downloaded 763,374 times in total on PyPI, including 76,496 in the last 30 days. The latest version is 0.4.5, released May 15, 2026.
Version0.4.5
Downloads
763.37k
License—
AuthorLMCache Team
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 47 series
Selected total517.39k
763.4kAll-time
76.5kLast 30 days
3.8kLast 24 h
0.03/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0125.8%
0.3.13
66.8k downloadsDownloads66.8k25.8% - 0214.0%
0.4.4
36.2k downloadsDownloads36.2k14.0% - 0312.4%
0.4.3
32.1k downloadsDownloads32.1k12.4% - 048.2%
0.4.6
21.3k downloadsDownloads21.3k8.2% - 057.9%
0.4.5
20.4k downloadsDownloads20.4k7.9% - 066.5%
0.4.7
16.9k downloadsDownloads16.9k6.5% - 076.0%
0.4.2
15.5k downloadsDownloads15.5k6.0% - 085.6%
0.5.0
14.6k downloadsDownloads14.6k5.6% - 0913.5%
Other
35.0k downloadsDownloads35.0k13.5%
Guess the next day
Thirteen recent days of lmcache downloads. Drag the green handle on the right to guess where day fourteen lands.