lmcache

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

lmcache has been downloaded 958,323 times in total on PyPI, including 107,390 in the last 30 days. The latest version is 0.4.5, released May 15, 2026.

Version0.4.5
Downloads
958.32k
License
AuthorLMCache Team
UpdatedMay 15, 2026

Downloads

Weekly, last 90d.
Includes CI traffic.

VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 66 series
Selected total527.54k
958.3kAll-time
107.4kLast 30 days
3.6kLast 24 h
0.03/sPer second

Version distribution

Share of downloads by released version. Computed over the last quarter.

  • 01

    0.5.2

    31.7k downloads
    12.0%
  • 02

    0.5.3

    31.6k downloads
    12.0%
  • 03

    0.5.1

    23.4k downloads
    8.9%
  • 04

    0.5.0

    22.3k downloads
    8.5%
  • 05

    0.4.7

    21.3k downloads
    8.1%
  • 06

    0.5.4

    18.9k downloads
    7.2%
  • 07

    0.3.9

    15.5k downloads
    5.9%
  • 08

    0.4.6

    15.1k downloads
    5.7%
  • 09

    Other

    83.9k downloads
    31.8%

Guess the next day

Thirteen recent days of lmcache downloads. Drag the green handle on the right to guess where day fourteen lands.

TRUTH3.6k2.1kTHUFRISATSUNMONTUEWEDTHUFRISATSUNMONTUE
    lmcache · 958.3k downloads on PyPI