lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

lmcache has been downloaded 820,046 times in total on PyPI, including 76,475 in the last 30 days. The latest version is 0.4.5, released May 15, 2026.

Version0.4.5
Downloads
820.05k
License
AuthorLMCache Team
UpdatedMay 15, 2026

Downloads

Weekly, last 90d.
Includes CI traffic.

VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 50 series
Selected total402.97k
820.0kAll-time
76.5kLast 30 days
2.9kLast 24 h
0.03/sPer second

Version distribution

Share of downloads by released version. Computed over the last quarter.

  • 01

    0.4.4

    34.6k downloads
    17.2%
  • 02

    0.4.6

    22.5k downloads
    11.2%
  • 03

    0.4.5

    21.6k downloads
    10.7%
  • 04

    0.5.0

    20.0k downloads
    9.9%
  • 05

    0.5.1

    19.7k downloads
    9.8%
  • 06

    0.4.7

    17.9k downloads
    8.9%
  • 07

    0.4.3

    13.3k downloads
    6.6%
  • 08

    0.5.0rc1

    11.4k downloads
    5.7%
  • 09

    Other

    40.5k downloads
    20.1%

Guess the next day

Thirteen recent days of lmcache downloads. Drag the green handle on the right to guess where day fourteen lands.

TRUTH2.9k2.4kSATSUNMONTUEWEDTHUFRISATSUNMONTUEWEDTHU
    lmcache · 820.0k downloads on PyPI