lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

lmcache has been downloaded 1,057,389 times in total on PyPI, including 73,372 in the last 30 days. The latest version is 0.5.6rc5, released Oct 12, 2026.

Version0.5.6rc5
Downloads
1.06M
License—
AuthorLMCache Team
UpdatedOct 12, 2026

Downloads

Weekly, last 90d.
Includes CI traffic.

VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 76 series
Selected total516.74k
1.1MAll-time
73.4kLast 30 days
4.6kLast 24 h
0.04/sPer second

Version distribution

Share of downloads by released version. Computed over the last quarter.

  • 01

    0.5.5

    48.0k downloads
    18.6%
  • 02

    0.5.3

    33.3k downloads
    12.9%
  • 03

    0.5.2

    32.1k downloads
    12.4%
  • 04

    0.5.4

    32.1k downloads
    12.4%
  • 05

    0.3.9

    15.5k downloads
    6.0%
  • 06

    0.5.1

    11.7k downloads
    4.5%
  • 07

    0.4.3

    9.8k downloads
    3.8%
  • 08

    0.4.7

    8.4k downloads
    3.3%
  • 09

    Other

    67.4k downloads
    26.1%

Guess the next day

Thirteen recent days of lmcache downloads. Drag the green handle on the right to guess where day fourteen lands.

TRUTH4.6k3.7kTHUFRISATSUNMONTUEWEDTHUFRISATMONTUEWED
    lmcache · 1.1M downloads on PyPI