pepy.tech

flash-tokenizer

1.2.0
46.06k

Extremely fast bert tokenizer