tokenizers/implementations/byte_level_bpe.py
11 distinct file contents recorded under this name ยท 2000 PyPI records
This name has more records than one lookup returns; counts here are a floor, not a total.
Python source file Reference
A .py file contains Python source code in plain text. The Python interpreter reads the file and runs the code directly, without a separate compile step. Developers write scripts, modules, and full programs in this format. A text editor can open and change the file. Python is one of the most used programming languages, thus .py files are common on many systems.
A file extension is only a part of the file name. It does not give a guarantee about the format or the content of a file. But on Windows, the extension selects the program that opens the file.
Hashes for this file
a567db49e69ec3d6ad58a5fc35fdb321189aeaa840c1731f66069e20d227ce8f
4394 bytes
- tokenizers
0.21.2
tokenizers-0.21.2-cp39-abi3-win32.whltokenizers-0.21.2-cp39-abi3-win_amd64.whl - tokenizers
0.21.2rc0
tokenizers-0.21.2rc0-cp39-abi3-win32.whltokenizers-0.21.2rc0-cp39-abi3-win_amd64.whl - tokenizers
0.21.4
tokenizers-0.21.4-cp39-abi3-win32.whltokenizers-0.21.4-cp39-abi3-win_amd64.whl - tokenizers
0.22.0
tokenizers-0.22.0-cp39-abi3-win32.whltokenizers-0.22.0-cp39-abi3-win_amd64.whl - tokenizers
0.22.1
tokenizers-0.22.1-cp39-abi3-win32.whltokenizers-0.22.1-cp39-abi3-win_amd64.whl - tokenizers
0.22.1rc0
tokenizers-0.22.1rc0-cp39-abi3-win32.whltokenizers-0.22.1rc0-cp39-abi3-win_amd64.whl - tokenizers
0.22.2
tokenizers-0.22.2-cp39-abi3-win32.whltokenizers-0.22.2-cp39-abi3-win_amd64.whltokenizers-0.22.2-cp39-abi3-win_arm64.whl - tokenizers
0.22.2rc0
tokenizers-0.22.2rc0-cp39-abi3-win_arm64.whl - tokenizers
0.23.0rc0
tokenizers-0.23.0rc0-cp310-abi3-win32.whltokenizers-0.23.0rc0-cp310-abi3-win_amd64.whltokenizers-0.23.0rc0-cp310-abi3-win_arm64.whl - tokenizers
0.23.1
tokenizers-0.23.1-cp310-abi3-win32.whltokenizers-0.23.1-cp310-abi3-win_amd64.whltokenizers-0.23.1-cp310-abi3-win_arm64.whl - tokenizers
0.23.1rc0
tokenizers-0.23.1rc0-cp310-abi3-win32.whltokenizers-0.23.1rc0-cp310-abi3-win_amd64.whltokenizers-0.23.1rc0-cp310-abi3-win_arm64.whl
8817a933fcf5b392b2ef314356b60b7372f96f262b228ba4efe934246b85d74b
4272 bytes
- tokenizers
0.21.2
tokenizers-0.21.2-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.2-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.2rc0
tokenizers-0.21.2rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.2rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.4
tokenizers-0.21.4-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.4-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.0
tokenizers-0.22.0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.0rc0
tokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.22.1
tokenizers-0.22.1-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.1-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.1rc0
tokenizers-0.22.1rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.1rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.1rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.1rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.1rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.1rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.2
tokenizers-0.22.2-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.2-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.2-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.2-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.2-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.2-cp39-abi3-musllinux_1_2_x86_64.whltokenizers-0.22.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2-pp310-pypy310_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2-pp310-pypy310_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2-pp310-pypy310_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2-pp39-pypy39_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2-pp39-pypy39_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2-pp39-pypy39_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.22.2rc0
tokenizers-0.22.2rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.2rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.2rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.2rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.2rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.2rc0-cp39-abi3-musllinux_1_2_x86_64.whltokenizers-0.22.2rc0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2rc0-pp310-pypy310_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2rc0-pp310-pypy310_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2rc0-pp310-pypy310_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.2rc0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2rc0-pp39-pypy39_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2rc0-pp39-pypy39_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2rc0-pp39-pypy39_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.23.0rc0
tokenizers-0.23.0rc0-cp310-abi3-macosx_10_12_x86_64.whltokenizers-0.23.0rc0-cp310-abi3-macosx_11_0_arm64.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_31_riscv64.whltokenizers-0.23.0rc0-cp310-abi3-musllinux_1_2_aarch64.whltokenizers-0.23.0rc0-cp310-abi3-musllinux_1_2_armv7l.whltokenizers-0.23.0rc0-cp310-abi3-musllinux_1_2_i686.whltokenizers-0.23.0rc0-cp310-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.23.1
tokenizers-0.23.1-cp310-abi3-macosx_10_12_x86_64.whltokenizers-0.23.1-cp310-abi3-macosx_11_0_arm64.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.23.1-cp310-abi3-manylinux_2_31_riscv64.whltokenizers-0.23.1-cp310-abi3-musllinux_1_2_aarch64.whltokenizers-0.23.1-cp310-abi3-musllinux_1_2_armv7l.whltokenizers-0.23.1-cp310-abi3-musllinux_1_2_i686.whltokenizers-0.23.1-cp310-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.23.1rc0
tokenizers-0.23.1rc0-cp310-abi3-macosx_10_12_x86_64.whltokenizers-0.23.1rc0-cp310-abi3-macosx_11_0_arm64.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_31_riscv64.whltokenizers-0.23.1rc0-cp310-abi3-musllinux_1_2_aarch64.whltokenizers-0.23.1rc0-cp310-abi3-musllinux_1_2_armv7l.whltokenizers-0.23.1rc0-cp310-abi3-musllinux_1_2_i686.whltokenizers-0.23.1rc0-cp310-abi3-musllinux_1_2_x86_64.whl
8820994965bd9f04207de5de3a2c15117eec2cd7cfb10c4eec20ae1264da1d7c
4411 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-win32.whltokenizers-0.13.2-cp310-cp310-win_amd64.whltokenizers-0.13.2-cp311-cp311-win32.whltokenizers-0.13.2-cp311-cp311-win_amd64.whltokenizers-0.13.2-cp37-cp37m-win32.whltokenizers-0.13.2-cp37-cp37m-win_amd64.whltokenizers-0.13.2-cp38-cp38-win32.whltokenizers-0.13.2-cp38-cp38-win_amd64.whltokenizers-0.13.2-cp39-cp39-win32.whltokenizers-0.13.2-cp39-cp39-win_amd64.whl - tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-win32.whltokenizers-0.13.3-cp310-cp310-win_amd64.whltokenizers-0.13.3-cp311-cp311-win32.whltokenizers-0.13.3-cp311-cp311-win_amd64.whltokenizers-0.13.3-cp37-cp37m-win32.whltokenizers-0.13.3-cp37-cp37m-win_amd64.whltokenizers-0.13.3-cp38-cp38-win32.whltokenizers-0.13.3-cp38-cp38-win_amd64.whltokenizers-0.13.3-cp39-cp39-win32.whltokenizers-0.13.3-cp39-cp39-win_amd64.whl - tokenizers
0.14.0
tokenizers-0.14.0-cp310-none-win32.whltokenizers-0.14.0-cp310-none-win_amd64.whltokenizers-0.14.0-cp311-none-win32.whltokenizers-0.14.0-cp311-none-win_amd64.whltokenizers-0.14.0-cp37-none-win32.whltokenizers-0.14.0-cp37-none-win_amd64.whltokenizers-0.14.0-cp38-none-win32.whltokenizers-0.14.0-cp38-none-win_amd64.whltokenizers-0.14.0-cp39-none-win32.whltokenizers-0.14.0-cp39-none-win_amd64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-none-win32.whltokenizers-0.14.1-cp310-none-win_amd64.whltokenizers-0.14.1-cp311-none-win32.whltokenizers-0.14.1-cp311-none-win_amd64.whltokenizers-0.14.1-cp37-none-win32.whltokenizers-0.14.1-cp37-none-win_amd64.whltokenizers-0.14.1-cp38-none-win32.whltokenizers-0.14.1-cp38-none-win_amd64.whltokenizers-0.14.1-cp39-none-win32.whltokenizers-0.14.1-cp39-none-win_amd64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-none-win32.whltokenizers-0.15.0-cp310-none-win_amd64.whltokenizers-0.15.0-cp311-none-win32.whltokenizers-0.15.0-cp311-none-win_amd64.whltokenizers-0.15.0-cp37-none-win32.whltokenizers-0.15.0-cp37-none-win_amd64.whltokenizers-0.15.0-cp38-none-win32.whltokenizers-0.15.0-cp38-none-win_amd64.whltokenizers-0.15.0-cp39-none-win32.whltokenizers-0.15.0-cp39-none-win_amd64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-none-win32.whltokenizers-0.15.1-cp310-none-win_amd64.whltokenizers-0.15.1-cp311-none-win32.whltokenizers-0.15.1-cp311-none-win_amd64.whltokenizers-0.15.1-cp312-none-win32.whltokenizers-0.15.1-cp312-none-win_amd64.whltokenizers-0.15.1-cp37-none-win32.whltokenizers-0.15.1-cp37-none-win_amd64.whltokenizers-0.15.1-cp38-none-win32.whltokenizers-0.15.1-cp38-none-win_amd64.whltokenizers-0.15.1-cp39-none-win32.whltokenizers-0.15.1-cp39-none-win_amd64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-none-win32.whltokenizers-0.15.2-cp310-none-win_amd64.whltokenizers-0.15.2-cp311-none-win32.whltokenizers-0.15.2-cp311-none-win_amd64.whltokenizers-0.15.2-cp312-none-win32.whltokenizers-0.15.2-cp312-none-win_amd64.whltokenizers-0.15.2-cp37-none-win32.whltokenizers-0.15.2-cp37-none-win_amd64.whltokenizers-0.15.2-cp38-none-win32.whltokenizers-0.15.2-cp38-none-win_amd64.whltokenizers-0.15.2-cp39-none-win32.whltokenizers-0.15.2-cp39-none-win_amd64.whl - tokenizers
0.19.0
tokenizers-0.19.0-cp310-none-win32.whltokenizers-0.19.0-cp310-none-win_amd64.whltokenizers-0.19.0-cp311-none-win32.whltokenizers-0.19.0-cp311-none-win_amd64.whltokenizers-0.19.0-cp312-none-win32.whltokenizers-0.19.0-cp312-none-win_amd64.whltokenizers-0.19.0-cp37-none-win32.whltokenizers-0.19.0-cp37-none-win_amd64.whltokenizers-0.19.0-cp38-none-win32.whltokenizers-0.19.0-cp38-none-win_amd64.whltokenizers-0.19.0-cp39-none-win32.whltokenizers-0.19.0-cp39-none-win_amd64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-none-win32.whltokenizers-0.19.1-cp310-none-win_amd64.whltokenizers-0.19.1-cp311-none-win32.whltokenizers-0.19.1-cp311-none-win_amd64.whltokenizers-0.19.1-cp312-none-win32.whltokenizers-0.19.1-cp312-none-win_amd64.whltokenizers-0.19.1-cp37-none-win32.whltokenizers-0.19.1-cp37-none-win_amd64.whltokenizers-0.19.1-cp38-none-win32.whltokenizers-0.19.1-cp38-none-win_amd64.whltokenizers-0.19.1-cp39-none-win32.whltokenizers-0.19.1-cp39-none-win_amd64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-none-win32.whltokenizers-0.20.0-cp310-none-win_amd64.whltokenizers-0.20.0-cp311-none-win32.whltokenizers-0.20.0-cp311-none-win_amd64.whltokenizers-0.20.0-cp312-none-win32.whltokenizers-0.20.0-cp312-none-win_amd64.whltokenizers-0.20.0-cp37-none-win32.whltokenizers-0.20.0-cp37-none-win_amd64.whltokenizers-0.20.0-cp38-none-win32.whltokenizers-0.20.0-cp38-none-win_amd64.whltokenizers-0.20.0-cp39-none-win32.whltokenizers-0.20.0-cp39-none-win_amd64.whl - tokenizers
0.20.1
tokenizers-0.20.1-cp310-none-win32.whltokenizers-0.20.1-cp310-none-win_amd64.whltokenizers-0.20.1-cp311-none-win32.whltokenizers-0.20.1-cp311-none-win_amd64.whltokenizers-0.20.1-cp312-none-win32.whltokenizers-0.20.1-cp312-none-win_amd64.whltokenizers-0.20.1-cp37-none-win32.whltokenizers-0.20.1-cp37-none-win_amd64.whltokenizers-0.20.1-cp38-none-win32.whltokenizers-0.20.1-cp38-none-win_amd64.whltokenizers-0.20.1-cp39-none-win32.whltokenizers-0.20.1-cp39-none-win_amd64.whl - tokenizers
0.20.2
tokenizers-0.20.2-cp310-none-win32.whltokenizers-0.20.2-cp310-none-win_amd64.whltokenizers-0.20.2-cp311-none-win32.whltokenizers-0.20.2-cp311-none-win_amd64.whltokenizers-0.20.2-cp312-none-win32.whltokenizers-0.20.2-cp312-none-win_amd64.whltokenizers-0.20.2-cp313-none-win32.whltokenizers-0.20.2-cp313-none-win_amd64.whltokenizers-0.20.2-cp37-none-win32.whltokenizers-0.20.2-cp37-none-win_amd64.whltokenizers-0.20.2-cp38-none-win32.whltokenizers-0.20.2-cp38-none-win_amd64.whltokenizers-0.20.2-cp39-none-win32.whltokenizers-0.20.2-cp39-none-win_amd64.whl - and 7 more releases view all on the content page
380fe3cb2dc44266136ba8677fe10ac0b385bb2ae8a8560e273db9cac3360549
4289 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.2-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.2-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl - tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.3-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.3-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl - tokenizers
0.14.0
tokenizers-0.14.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.15.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.19.0
tokenizers-0.19.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.1
tokenizers-0.20.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.2
tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - and 7 more releases view all on the content page
155e6f07542f6d9c62fc32ca2f2fecd6c629429c9a07589ca0fcbdce06d3a81a
4449 bytes
- tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-win32.whltokenizers-0.12.0-cp310-cp310-win_amd64.whltokenizers-0.12.0-cp37-cp37m-win32.whltokenizers-0.12.0-cp37-cp37m-win_amd64.whltokenizers-0.12.0-cp38-cp38-win32.whltokenizers-0.12.0-cp38-cp38-win_amd64.whltokenizers-0.12.0-cp39-cp39-win32.whltokenizers-0.12.0-cp39-cp39-win_amd64.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-win32.whltokenizers-0.12.1-cp310-cp310-win_amd64.whltokenizers-0.12.1-cp37-cp37m-win32.whltokenizers-0.12.1-cp37-cp37m-win_amd64.whltokenizers-0.12.1-cp38-cp38-win32.whltokenizers-0.12.1-cp38-cp38-win_amd64.whltokenizers-0.12.1-cp39-cp39-win32.whltokenizers-0.12.1-cp39-cp39-win_amd64.whl - tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-win32.whltokenizers-0.13.0-cp310-cp310-win_amd64.whltokenizers-0.13.0-cp37-cp37m-win32.whltokenizers-0.13.0-cp37-cp37m-win_amd64.whltokenizers-0.13.0-cp38-cp38-win32.whltokenizers-0.13.0-cp38-cp38-win_amd64.whltokenizers-0.13.0-cp39-cp39-win32.whltokenizers-0.13.0-cp39-cp39-win_amd64.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-win32.whltokenizers-0.13.1-cp310-cp310-win_amd64.whltokenizers-0.13.1-cp37-cp37m-win32.whltokenizers-0.13.1-cp37-cp37m-win_amd64.whltokenizers-0.13.1-cp38-cp38-win32.whltokenizers-0.13.1-cp38-cp38-win_amd64.whltokenizers-0.13.1-cp39-cp39-win32.whltokenizers-0.13.1-cp39-cp39-win_amd64.whl
24688de09b678dfbb8e7d2685448cbc4531ebff6a9bab3484cfbf2093f80042a
4321 bytes
- tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.0-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.0-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.1-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
e2233eb62b918ac24860b15b23f7909be543a0a268b5ac5adc31ef1885335527
4344 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-win32.whltokenizers-0.10.0-cp35-cp35m-win_amd64.whltokenizers-0.10.0-cp36-cp36m-win32.whltokenizers-0.10.0-cp36-cp36m-win_amd64.whltokenizers-0.10.0-cp37-cp37m-win32.whltokenizers-0.10.0-cp37-cp37m-win_amd64.whltokenizers-0.10.0-cp38-cp38-win32.whltokenizers-0.10.0-cp38-cp38-win_amd64.whltokenizers-0.10.0-cp39-cp39-win32.whltokenizers-0.10.0-cp39-cp39-win_amd64.whl - tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-win32.whltokenizers-0.10.1-cp35-cp35m-win_amd64.whltokenizers-0.10.1-cp36-cp36m-win32.whltokenizers-0.10.1-cp36-cp36m-win_amd64.whltokenizers-0.10.1-cp37-cp37m-win32.whltokenizers-0.10.1-cp37-cp37m-win_amd64.whltokenizers-0.10.1-cp38-cp38-win32.whltokenizers-0.10.1-cp38-cp38-win_amd64.whltokenizers-0.10.1-cp39-cp39-win32.whltokenizers-0.10.1-cp39-cp39-win_amd64.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-win32.whltokenizers-0.10.2-cp35-cp35m-win_amd64.whltokenizers-0.10.2-cp36-cp36m-win32.whltokenizers-0.10.2-cp36-cp36m-win_amd64.whltokenizers-0.10.2-cp37-cp37m-win32.whltokenizers-0.10.2-cp37-cp37m-win_amd64.whltokenizers-0.10.2-cp38-cp38-win32.whltokenizers-0.10.2-cp38-cp38-win_amd64.whltokenizers-0.10.2-cp39-cp39-win32.whltokenizers-0.10.2-cp39-cp39-win_amd64.whl - tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-win32.whltokenizers-0.10.3-cp36-cp36m-win_amd64.whltokenizers-0.10.3-cp37-cp37m-win32.whltokenizers-0.10.3-cp37-cp37m-win_amd64.whltokenizers-0.10.3-cp38-cp38-win32.whltokenizers-0.10.3-cp38-cp38-win_amd64.whltokenizers-0.10.3-cp39-cp39-win32.whltokenizers-0.10.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.0
tokenizers-0.11.0-cp37-cp37m-win32.whltokenizers-0.11.0-cp37-cp37m-win_amd64.whltokenizers-0.11.0-cp38-cp38-win32.whltokenizers-0.11.0-cp38-cp38-win_amd64.whltokenizers-0.11.0-cp39-cp39-win32.whltokenizers-0.11.0-cp39-cp39-win_amd64.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp37-cp37m-win32.whltokenizers-0.11.1-cp37-cp37m-win_amd64.whltokenizers-0.11.1-cp38-cp38-win32.whltokenizers-0.11.1-cp38-cp38-win_amd64.whltokenizers-0.11.1-cp39-cp39-win32.whltokenizers-0.11.1-cp39-cp39-win_amd64.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp37-cp37m-win32.whltokenizers-0.11.2-cp37-cp37m-win_amd64.whltokenizers-0.11.2-cp38-cp38-win32.whltokenizers-0.11.2-cp38-cp38-win_amd64.whltokenizers-0.11.2-cp39-cp39-win32.whltokenizers-0.11.2-cp39-cp39-win_amd64.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-win32.whltokenizers-0.11.3-cp310-cp310-win_amd64.whltokenizers-0.11.3-cp37-cp37m-win32.whltokenizers-0.11.3-cp37-cp37m-win_amd64.whltokenizers-0.11.3-cp38-cp38-win32.whltokenizers-0.11.3-cp38-cp38-win_amd64.whltokenizers-0.11.3-cp39-cp39-win32.whltokenizers-0.11.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-win32.whltokenizers-0.11.4-cp310-cp310-win_amd64.whltokenizers-0.11.4-cp37-cp37m-win32.whltokenizers-0.11.4-cp37-cp37m-win_amd64.whltokenizers-0.11.4-cp38-cp38-win32.whltokenizers-0.11.4-cp38-cp38-win_amd64.whltokenizers-0.11.4-cp39-cp39-win32.whltokenizers-0.11.4-cp39-cp39-win_amd64.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-win32.whltokenizers-0.11.5-cp310-cp310-win_amd64.whltokenizers-0.11.5-cp37-cp37m-win32.whltokenizers-0.11.5-cp37-cp37m-win_amd64.whltokenizers-0.11.5-cp38-cp38-win32.whltokenizers-0.11.5-cp38-cp38-win_amd64.whltokenizers-0.11.5-cp39-cp39-win32.whltokenizers-0.11.5-cp39-cp39-win_amd64.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-win32.whltokenizers-0.11.6-cp310-cp310-win_amd64.whltokenizers-0.11.6-cp37-cp37m-win32.whltokenizers-0.11.6-cp37-cp37m-win_amd64.whltokenizers-0.11.6-cp38-cp38-win32.whltokenizers-0.11.6-cp38-cp38-win_amd64.whltokenizers-0.11.6-cp39-cp39-win32.whltokenizers-0.11.6-cp39-cp39-win_amd64.whl
35ade98c998d2db30f2789ed5765a72cf64d6fc09d14b8f1501da7ef0fce29ce
4221 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.0-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.0-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.0-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.0-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.0-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.1-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.1-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.1-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.1-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.2-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.2-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.2-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.2-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl - tokenizers
0.11.0
tokenizers-0.11.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.6-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp36-cp36m-macosx_12_0_arm64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.6-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.6-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.11.6-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
004dc63c4016df44b337b5dbf2c3c7a2aeeaba3b2004c1bbe7f7e67647eb269d
3635 bytes
- tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-win32.whltokenizers-0.10.0rc1-cp35-cp35m-win_amd64.whltokenizers-0.10.0rc1-cp36-cp36m-win32.whltokenizers-0.10.0rc1-cp36-cp36m-win_amd64.whltokenizers-0.10.0rc1-cp37-cp37m-win32.whltokenizers-0.10.0rc1-cp37-cp37m-win_amd64.whltokenizers-0.10.0rc1-cp38-cp38-win32.whltokenizers-0.10.0rc1-cp38-cp38-win_amd64.whltokenizers-0.10.0rc1-cp39-cp39-win32.whltokenizers-0.10.0rc1-cp39-cp39-win_amd64.whl
646046a72e1688779fd95474649a275e68beda8299832c37f929def8ec74bc54
3531 bytes
- tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_s390x.whl
7995e2bd3d9272961f74f3f681d54f21b731376660e7cde869fda67b8831c955
3627 bytes
- tokenizers
0.9.0
tokenizers-0.9.0-cp38-cp38-win_amd64.whl - tokenizers
0.9.1
tokenizers-0.9.1-cp35-cp35m-win32.whltokenizers-0.9.1-cp36-cp36m-win32.whltokenizers-0.9.1-cp37-cp37m-win32.whltokenizers-0.9.1-cp38-cp38-win32.whl - tokenizers
0.9.2
tokenizers-0.9.2-cp35-cp35m-win32.whltokenizers-0.9.2-cp35-cp35m-win_amd64.whltokenizers-0.9.2-cp36-cp36m-win32.whltokenizers-0.9.2-cp36-cp36m-win_amd64.whltokenizers-0.9.2-cp37-cp37m-win32.whltokenizers-0.9.2-cp37-cp37m-win_amd64.whltokenizers-0.9.2-cp38-cp38-win32.whltokenizers-0.9.2-cp38-cp38-win_amd64.whl - tokenizers
0.9.3
tokenizers-0.9.3-cp35-cp35m-win32.whltokenizers-0.9.3-cp35-cp35m-win_amd64.whltokenizers-0.9.3-cp36-cp36m-win32.whltokenizers-0.9.3-cp36-cp36m-win_amd64.whltokenizers-0.9.3-cp37-cp37m-win32.whltokenizers-0.9.3-cp37-cp37m-win_amd64.whltokenizers-0.9.3-cp38-cp38-win32.whltokenizers-0.9.3-cp38-cp38-win_amd64.whl - tokenizers
0.9.4
tokenizers-0.9.4-cp35-cp35m-win32.whltokenizers-0.9.4-cp35-cp35m-win_amd64.whltokenizers-0.9.4-cp36-cp36m-win32.whltokenizers-0.9.4-cp36-cp36m-win_amd64.whltokenizers-0.9.4-cp37-cp37m-win32.whltokenizers-0.9.4-cp37-cp37m-win_amd64.whltokenizers-0.9.4-cp38-cp38-win32.whltokenizers-0.9.4-cp38-cp38-win_amd64.whltokenizers-0.9.4-cp39-cp39-win32.whltokenizers-0.9.4-cp39-cp39-win_amd64.whl