lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

lmcache has been downloaded 1,002,795 times in total on PyPI, including 65,306 in the last 30 days. The latest version is 0.4.5, released May 15, 2026.

Version0.4.5
Downloads
1.00M
License—
AuthorLMCache Team
UpdatedMay 15, 2026

Downloads

Weekly, last 90d.
Includes CI traffic.

VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 71 series
Selected total517.77k
1.0MAll-time
65.3kLast 30 days
3.0kLast 24 h
0.02/sPer second

Version distribution

Share of downloads by released version. Computed over the last quarter.

  • 01

    0.5.3

    32.7k downloads
    12.8%
  • 02

    0.5.2

    31.9k downloads
    12.5%
  • 03

    0.5.4

    30.1k downloads
    11.8%
  • 04

    0.5.1

    24.2k downloads
    9.5%
  • 05

    0.5.0

    18.4k downloads
    7.2%
  • 06

    0.5.5

    16.6k downloads
    6.5%
  • 07

    0.3.9

    15.5k downloads
    6.1%
  • 08

    0.4.3

    12.0k downloads
    4.7%
  • 09

    Other

    73.9k downloads
    29.0%

Guess the next day

Thirteen recent days of lmcache downloads. Drag the green handle on the right to guess where day fourteen lands.

TRUTH3.0k1.9kTHUFRISATSUNMONTUEWEDTHUFRISATSUNMONTUE
    lmcache · 1.0M downloads on PyPI