tokenizers
Reworked tokenizers Python bindings, over the pipeline encode path (not for release yet)
tokenizers has been downloaded 3,251,736,388 times in total on PyPI, including 219,759,127 in the last 30 days. The latest version is 1.0.0rc5, released Nov 20, 2026.
Version1.0.0rc5
Downloads
3.25G
License—
Author—
UpdatedNov 20, 2026
Downloads
Weekly, last 90d.
Includes CI traffic.
VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 128 series
Selected total1.15G
3.3GAll-time
219.8MLast 30 days
8.1MLast 24 h
89.87/sPer second
Sponsored
Sponsorships keep pepy free to read
Version distribution
Share of downloads by released version. Computed over the last quarter.
- 0131.1%
0.22.2
179.4M downloadsDownloads179.4M31.1% - 0223.0%
0.23.3
132.6M downloadsDownloads132.6M23.0% - 0318.8%
0.23.2
108.2M downloadsDownloads108.2M18.8% - 0415.3%
0.23.1
88.0M downloadsDownloads88.0M15.3% - 053.0%
0.21.4
17.5M downloadsDownloads17.5M3.0% - 062.2%
0.22.1
12.5M downloadsDownloads12.5M2.2% - 071.0%
0.20.3
6.0M downloadsDownloads6.0M1.0% - 080.9%
0.13.3
5.4M downloadsDownloads5.4M0.9% - 094.6%
Other
26.4M downloadsDownloads26.4M4.6%
Guess the next day
Thirteen recent days of tokenizers downloads. Drag the green handle on the right to guess where day fourteen lands.