tokenizers

Reworked tokenizers Python bindings, over the pipeline encode path (not for release yet)

tokenizers has been downloaded 3,251,736,388 times in total on PyPI, including 219,759,127 in the last 30 days. The latest version is 1.0.0rc5, released Nov 20, 2026.

Version1.0.0rc5
Downloads
3.25G
License—
Author—
UpdatedNov 20, 2026

Downloads

Weekly, last 90d.
Includes CI traffic.

VersionsTotal0.*
Range
View
Granularity
Group by
CI traffic
Stack: OffCI: Included2 / 128 series
Selected total1.15G
3.3GAll-time
219.8MLast 30 days
8.1MLast 24 h
89.87/sPer second

Version distribution

Share of downloads by released version. Computed over the last quarter.

  • 01

    0.22.2

    179.4M downloads
    31.1%
  • 02

    0.23.3

    132.6M downloads
    23.0%
  • 03

    0.23.2

    108.2M downloads
    18.8%
  • 04

    0.23.1

    88.0M downloads
    15.3%
  • 05

    0.21.4

    17.5M downloads
    3.0%
  • 06

    0.22.1

    12.5M downloads
    2.2%
  • 07

    0.20.3

    6.0M downloads
    1.0%
  • 08

    0.13.3

    5.4M downloads
    0.9%
  • 09

    Other

    26.4M downloads
    4.6%

Guess the next day

Thirteen recent days of tokenizers downloads. Drag the green handle on the right to guess where day fourteen lands.

TRUTH8.1M8.6MSATSUNMONTUEWEDTHUFRISATSUNMONTUEWEDTHU
    tokenizers · 3.3G downloads on PyPI