tokenizers
Reworked tokenizers Python bindings, over the pipeline encode path (not for release yet)
tokenizers has been downloaded 2,952,064,305 times in total on PyPI, including 173,627,240 in the last 30 days. The latest version is 1.0.0rc2, released Sep 21, 2026.
Version1.0.0rc2
Downloads
2.95G
License—
Author—
UpdatedSep 21, 2026
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 124 series
Selected total1.27G
3.0GAll-time
173.6MLast 30 days
7.0MLast 24 h
72.33/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0136.8%
0.23.1
232.9M downloadsDownloads232.9M36.8% - 0235.7%
0.22.2
226.2M downloadsDownloads226.2M35.7% - 0314.1%
0.23.2
89.3M downloadsDownloads89.3M14.1% - 043.4%
0.21.4
21.5M downloadsDownloads21.5M3.4% - 052.4%
0.22.1
15.5M downloadsDownloads15.5M2.4% - 061.1%
0.13.3
7.1M downloadsDownloads7.1M1.1% - 071.0%
0.20.3
6.6M downloadsDownloads6.6M1.0% - 081.0%
0.15.2
6.4M downloadsDownloads6.4M1.0% - 094.3%
Other
27.1M downloadsDownloads27.1M4.3%
Guess the next day
Thirteen recent days of tokenizers downloads. Drag the green handle on the right to guess where day fourteen lands.