thaw-vllm
The fork primitive for LLM inference. Snapshot a running session — weights + KV cache + scheduler state — and hydrate it into N divergent children that skip prefill. For RL rollouts, parallel coding agents, agent branching. Supports vLLM and SGLang.
thaw-vllm has been downloaded 10,858 times in total on PyPI, including 503 in the last 30 days. The latest version is 0.6.0, released Jun 7, 2026. It is distributed under the Apache-2.0 license.
Version0.6.0
Downloads
10.86k
LicenseApache-2.0
AuthorNils Matteson
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 17 series
Selected total3.01k
10.9kAll-time
503Last 30 days
5Last 24 h
<0.01/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0131.5%
0.6.0
474 downloadsDownloads47431.5% - 026.6%
0.5.1
99 downloadsDownloads996.6% - 035.8%
0.5.0
87 downloadsDownloads875.8% - 044.7%
0.1.4
70 downloadsDownloads704.7% - 054.5%
0.1.5
67 downloadsDownloads674.5% - 064.5%
0.3.1
67 downloadsDownloads674.5% - 074.5%
0.4.0
67 downloadsDownloads674.5% - 084.5%
0.2.1
67 downloadsDownloads674.5% - 0933.7%
Other
507 downloadsDownloads50733.7%
Guess the next day
Thirteen recent days of thaw-vllm downloads. Drag the green handle on the right to guess where day fourteen lands.