lmcache
A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
lmcache has been downloaded 901,557 times in total on PyPI, including 108,543 in the last 30 days. The latest version is 0.4.5, released May 15, 2026.
Version0.4.5
Downloads
901.56k
License—
AuthorLMCache Team
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 58 series
Selected total487.54k
901.6kAll-time
108.5kLast 30 days
6.4kLast 24 h
0.06/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0112.7%
0.5.2
31.0k downloadsDownloads31.0k12.7% - 029.5%
0.4.6
23.2k downloadsDownloads23.2k9.5% - 039.1%
0.5.1
22.1k downloadsDownloads22.1k9.1% - 049.0%
0.5.0
22.0k downloadsDownloads22.0k9.0% - 058.6%
0.4.5
21.0k downloadsDownloads21.0k8.6% - 067.6%
0.4.7
18.5k downloadsDownloads18.5k7.6% - 077.1%
0.5.3
17.3k downloadsDownloads17.3k7.1% - 086.4%
0.3.9
15.7k downloadsDownloads15.7k6.4% - 0930.0%
Other
73.0k downloadsDownloads73.0k30.0%
Guess the next day
Thirteen recent days of lmcache downloads. Drag the green handle on the right to guess where day fourteen lands.