lmcache
A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
lmcache has been downloaded 1,130,342 times in total on PyPI, including 104,034 in the last 30 days. The latest version is 0.5.7rc4, released Nov 3, 2026. It is distributed under the Apache-2.0 license.
Version0.5.7rc4
Downloads
1.13M
LicenseApache-2.0
AuthorLMCache Team
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 80 series
Selected total541.34k
1.1MAll-time
104.0kLast 30 days
4.4kLast 24 h
0.04/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0125.5%
0.5.5
69.1k downloadsDownloads69.1k25.5% - 0212.2%
0.5.3
33.1k downloadsDownloads33.1k12.2% - 0312.2%
0.5.4
33.1k downloadsDownloads33.1k12.2% - 049.1%
0.5.6
24.6k downloadsDownloads24.6k9.1% - 057.7%
0.4.7
20.9k downloadsDownloads20.9k7.7% - 065.7%
0.3.9
15.5k downloadsDownloads15.5k5.7% - 072.3%
0.4.4
6.1k downloadsDownloads6.1k2.3% - 081.5%
0.4.3
4.1k downloadsDownloads4.1k1.5% - 0923.7%
Other
64.2k downloadsDownloads64.2k23.7%
Guess the next day
Thirteen recent days of lmcache downloads. Drag the green handle on the right to guess where day fourteen lands.