tokenizers/implementations/sentencepiece_bpe.py
16 distinct file contents recorded under this name ยท 2000 PyPI records
This name has more records than one lookup returns; counts here are a floor, not a total.
Python source file Reference
A .py file contains Python source code in plain text. The Python interpreter reads the file and runs the code directly, without a separate compile step. Developers write scripts, modules, and full programs in this format. A text editor can open and change the file. Python is one of the most used programming languages, thus .py files are common on many systems.
A file extension is only a part of the file name. It does not give a guarantee about the format or the content of a file. But on Windows, the extension selects the program that opens the file.
Hashes for this file
e3f74915c36ccaf0bf175c019d60c1aae5acb1b50c57890ff811177ae1dcc6d2
3824 bytes
- tokenizers
0.21.2
tokenizers-0.21.2-cp39-abi3-win32.whltokenizers-0.21.2-cp39-abi3-win_amd64.whl - tokenizers
0.21.2rc0
tokenizers-0.21.2rc0-cp39-abi3-win32.whltokenizers-0.21.2rc0-cp39-abi3-win_amd64.whl - tokenizers
0.21.4
tokenizers-0.21.4-cp39-abi3-win32.whltokenizers-0.21.4-cp39-abi3-win_amd64.whl - tokenizers
0.22.0
tokenizers-0.22.0-cp39-abi3-win32.whltokenizers-0.22.0-cp39-abi3-win_amd64.whl - tokenizers
0.22.1
tokenizers-0.22.1-cp39-abi3-win32.whltokenizers-0.22.1-cp39-abi3-win_amd64.whl - tokenizers
0.22.1rc0
tokenizers-0.22.1rc0-cp39-abi3-win32.whltokenizers-0.22.1rc0-cp39-abi3-win_amd64.whl - tokenizers
0.22.2
tokenizers-0.22.2-cp39-abi3-win32.whltokenizers-0.22.2-cp39-abi3-win_amd64.whltokenizers-0.22.2-cp39-abi3-win_arm64.whl - tokenizers
0.22.2rc0
tokenizers-0.22.2rc0-cp39-abi3-win_arm64.whl - tokenizers
0.23.0rc0
tokenizers-0.23.0rc0-cp310-abi3-win32.whltokenizers-0.23.0rc0-cp310-abi3-win_amd64.whltokenizers-0.23.0rc0-cp310-abi3-win_arm64.whl - tokenizers
0.23.1
tokenizers-0.23.1-cp310-abi3-win32.whltokenizers-0.23.1-cp310-abi3-win_amd64.whltokenizers-0.23.1-cp310-abi3-win_arm64.whl - tokenizers
0.23.1rc0
tokenizers-0.23.1rc0-cp310-abi3-win32.whltokenizers-0.23.1rc0-cp310-abi3-win_amd64.whltokenizers-0.23.1rc0-cp310-abi3-win_arm64.whl
734f1f29fea2f7613646c2a0b31cbb2f365f617f3e3000874911bc53f239cad6
3721 bytes
- tokenizers
0.21.2
tokenizers-0.21.2-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.2-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.2rc0
tokenizers-0.21.2rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.2rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.4
tokenizers-0.21.4-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.4-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.0
tokenizers-0.22.0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.0rc0
tokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.22.1
tokenizers-0.22.1-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.1-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.1rc0
tokenizers-0.22.1rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.1rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.1rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.1rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.1rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.1rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.1rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.2
tokenizers-0.22.2-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.2-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.2-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.2-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.2-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.2-cp39-abi3-musllinux_1_2_x86_64.whltokenizers-0.22.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2-pp310-pypy310_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2-pp310-pypy310_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2-pp310-pypy310_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2-pp39-pypy39_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2-pp39-pypy39_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2-pp39-pypy39_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.22.2rc0
tokenizers-0.22.2rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.2rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.2rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.2rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.2rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.2rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.2rc0-cp39-abi3-musllinux_1_2_x86_64.whltokenizers-0.22.2rc0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2rc0-pp310-pypy310_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2rc0-pp310-pypy310_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2rc0-pp310-pypy310_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.2rc0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.2rc0-pp39-pypy39_pp73-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.2rc0-pp39-pypy39_pp73-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.2rc0-pp39-pypy39_pp73-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.23.0rc0
tokenizers-0.23.0rc0-cp310-abi3-macosx_10_12_x86_64.whltokenizers-0.23.0rc0-cp310-abi3-macosx_11_0_arm64.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.23.0rc0-cp310-abi3-manylinux_2_31_riscv64.whltokenizers-0.23.0rc0-cp310-abi3-musllinux_1_2_aarch64.whltokenizers-0.23.0rc0-cp310-abi3-musllinux_1_2_armv7l.whltokenizers-0.23.0rc0-cp310-abi3-musllinux_1_2_i686.whltokenizers-0.23.0rc0-cp310-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.23.1
tokenizers-0.23.1-cp310-abi3-macosx_10_12_x86_64.whltokenizers-0.23.1-cp310-abi3-macosx_11_0_arm64.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.23.1-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.23.1-cp310-abi3-manylinux_2_31_riscv64.whltokenizers-0.23.1-cp310-abi3-musllinux_1_2_aarch64.whltokenizers-0.23.1-cp310-abi3-musllinux_1_2_armv7l.whltokenizers-0.23.1-cp310-abi3-musllinux_1_2_i686.whltokenizers-0.23.1-cp310-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.23.1rc0
tokenizers-0.23.1rc0-cp310-abi3-macosx_10_12_x86_64.whltokenizers-0.23.1rc0-cp310-abi3-macosx_11_0_arm64.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.23.1rc0-cp310-abi3-manylinux_2_31_riscv64.whltokenizers-0.23.1rc0-cp310-abi3-musllinux_1_2_aarch64.whltokenizers-0.23.1rc0-cp310-abi3-musllinux_1_2_armv7l.whltokenizers-0.23.1rc0-cp310-abi3-musllinux_1_2_i686.whltokenizers-0.23.1rc0-cp310-abi3-musllinux_1_2_x86_64.whl
329626284ce2b536f84514cdec4952686ad56450b53c3fbc3f99368395bad78e
3841 bytes
- tokenizers
0.19.0
tokenizers-0.19.0-cp310-none-win32.whltokenizers-0.19.0-cp310-none-win_amd64.whltokenizers-0.19.0-cp311-none-win32.whltokenizers-0.19.0-cp311-none-win_amd64.whltokenizers-0.19.0-cp312-none-win32.whltokenizers-0.19.0-cp312-none-win_amd64.whltokenizers-0.19.0-cp37-none-win32.whltokenizers-0.19.0-cp37-none-win_amd64.whltokenizers-0.19.0-cp38-none-win32.whltokenizers-0.19.0-cp38-none-win_amd64.whltokenizers-0.19.0-cp39-none-win32.whltokenizers-0.19.0-cp39-none-win_amd64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-none-win32.whltokenizers-0.19.1-cp310-none-win_amd64.whltokenizers-0.19.1-cp311-none-win32.whltokenizers-0.19.1-cp311-none-win_amd64.whltokenizers-0.19.1-cp312-none-win32.whltokenizers-0.19.1-cp312-none-win_amd64.whltokenizers-0.19.1-cp37-none-win32.whltokenizers-0.19.1-cp37-none-win_amd64.whltokenizers-0.19.1-cp38-none-win32.whltokenizers-0.19.1-cp38-none-win_amd64.whltokenizers-0.19.1-cp39-none-win32.whltokenizers-0.19.1-cp39-none-win_amd64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-none-win32.whltokenizers-0.20.0-cp310-none-win_amd64.whltokenizers-0.20.0-cp311-none-win32.whltokenizers-0.20.0-cp311-none-win_amd64.whltokenizers-0.20.0-cp312-none-win32.whltokenizers-0.20.0-cp312-none-win_amd64.whltokenizers-0.20.0-cp37-none-win32.whltokenizers-0.20.0-cp37-none-win_amd64.whltokenizers-0.20.0-cp38-none-win32.whltokenizers-0.20.0-cp38-none-win_amd64.whltokenizers-0.20.0-cp39-none-win32.whltokenizers-0.20.0-cp39-none-win_amd64.whl - tokenizers
0.20.1
tokenizers-0.20.1-cp310-none-win32.whltokenizers-0.20.1-cp310-none-win_amd64.whltokenizers-0.20.1-cp311-none-win32.whltokenizers-0.20.1-cp311-none-win_amd64.whltokenizers-0.20.1-cp312-none-win32.whltokenizers-0.20.1-cp312-none-win_amd64.whltokenizers-0.20.1-cp37-none-win32.whltokenizers-0.20.1-cp37-none-win_amd64.whltokenizers-0.20.1-cp38-none-win32.whltokenizers-0.20.1-cp38-none-win_amd64.whltokenizers-0.20.1-cp39-none-win32.whltokenizers-0.20.1-cp39-none-win_amd64.whl - tokenizers
0.20.2
tokenizers-0.20.2-cp310-none-win32.whltokenizers-0.20.2-cp310-none-win_amd64.whltokenizers-0.20.2-cp311-none-win32.whltokenizers-0.20.2-cp311-none-win_amd64.whltokenizers-0.20.2-cp312-none-win32.whltokenizers-0.20.2-cp312-none-win_amd64.whltokenizers-0.20.2-cp313-none-win32.whltokenizers-0.20.2-cp313-none-win_amd64.whltokenizers-0.20.2-cp37-none-win32.whltokenizers-0.20.2-cp37-none-win_amd64.whltokenizers-0.20.2-cp38-none-win32.whltokenizers-0.20.2-cp38-none-win_amd64.whltokenizers-0.20.2-cp39-none-win32.whltokenizers-0.20.2-cp39-none-win_amd64.whl - tokenizers
0.20.3
tokenizers-0.20.3-cp310-none-win32.whltokenizers-0.20.3-cp310-none-win_amd64.whltokenizers-0.20.3-cp311-none-win32.whltokenizers-0.20.3-cp311-none-win_amd64.whltokenizers-0.20.3-cp312-none-win32.whltokenizers-0.20.3-cp312-none-win_amd64.whltokenizers-0.20.3-cp313-none-win32.whltokenizers-0.20.3-cp313-none-win_amd64.whltokenizers-0.20.3-cp37-none-win32.whltokenizers-0.20.3-cp37-none-win_amd64.whltokenizers-0.20.3-cp38-none-win32.whltokenizers-0.20.3-cp38-none-win_amd64.whltokenizers-0.20.3-cp39-none-win32.whltokenizers-0.20.3-cp39-none-win_amd64.whl - tokenizers
0.20.4
tokenizers-0.20.4-cp39-abi3-win32.whltokenizers-0.20.4-cp39-abi3-win_amd64.whl - tokenizers
0.20.4rc0
tokenizers-0.20.4rc0-cp39-abi3-win32.whltokenizers-0.20.4rc0-cp39-abi3-win_amd64.whl - tokenizers
0.21.0
tokenizers-0.21.0-cp39-abi3-win32.whltokenizers-0.21.0-cp39-abi3-win_amd64.whl - tokenizers
0.21.0rc0
tokenizers-0.21.0rc0-cp39-abi3-win32.whltokenizers-0.21.0rc0-cp39-abi3-win_amd64.whl - tokenizers
0.21.1
tokenizers-0.21.1-cp39-abi3-win32.whltokenizers-0.21.1-cp39-abi3-win_amd64.whl - tokenizers
0.21.1rc0
tokenizers-0.21.1rc0-cp39-abi3-win32.whltokenizers-0.21.1rc0-cp39-abi3-win_amd64.whl
2f0ae87e8a219d47cc13694ada5418a3240884ff3844fd022251d16a3d21c8db
3738 bytes
- tokenizers
0.19.0
tokenizers-0.19.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.1
tokenizers-0.20.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.2
tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.3
tokenizers-0.20.3-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.3-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.3-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.3-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.20.3-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.3-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.3-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.3-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.4
tokenizers-0.20.4-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.20.4-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.20.4rc0
tokenizers-0.20.4rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.20.4rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.0
tokenizers-0.21.0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.0rc0
tokenizers-0.21.0rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.0rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.1
tokenizers-0.21.1-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.1-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.1rc0
tokenizers-0.21.1rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.1rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_x86_64.whl
5b36ef5c8b7d0cd8e3e6e00dc76e3dc3145feb1f6e33d6c1fdaf6183ac9b3eec
3781 bytes
- tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-win32.whltokenizers-0.13.3-cp310-cp310-win_amd64.whltokenizers-0.13.3-cp311-cp311-win32.whltokenizers-0.13.3-cp311-cp311-win_amd64.whltokenizers-0.13.3-cp37-cp37m-win32.whltokenizers-0.13.3-cp37-cp37m-win_amd64.whltokenizers-0.13.3-cp38-cp38-win32.whltokenizers-0.13.3-cp38-cp38-win_amd64.whltokenizers-0.13.3-cp39-cp39-win32.whltokenizers-0.13.3-cp39-cp39-win_amd64.whl - tokenizers
0.14.0
tokenizers-0.14.0-cp310-none-win32.whltokenizers-0.14.0-cp310-none-win_amd64.whltokenizers-0.14.0-cp311-none-win32.whltokenizers-0.14.0-cp311-none-win_amd64.whltokenizers-0.14.0-cp37-none-win32.whltokenizers-0.14.0-cp37-none-win_amd64.whltokenizers-0.14.0-cp38-none-win32.whltokenizers-0.14.0-cp38-none-win_amd64.whltokenizers-0.14.0-cp39-none-win32.whltokenizers-0.14.0-cp39-none-win_amd64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-none-win32.whltokenizers-0.14.1-cp310-none-win_amd64.whltokenizers-0.14.1-cp311-none-win32.whltokenizers-0.14.1-cp311-none-win_amd64.whltokenizers-0.14.1-cp37-none-win32.whltokenizers-0.14.1-cp37-none-win_amd64.whltokenizers-0.14.1-cp38-none-win32.whltokenizers-0.14.1-cp38-none-win_amd64.whltokenizers-0.14.1-cp39-none-win32.whltokenizers-0.14.1-cp39-none-win_amd64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-none-win32.whltokenizers-0.15.0-cp310-none-win_amd64.whltokenizers-0.15.0-cp311-none-win32.whltokenizers-0.15.0-cp311-none-win_amd64.whltokenizers-0.15.0-cp37-none-win32.whltokenizers-0.15.0-cp37-none-win_amd64.whltokenizers-0.15.0-cp38-none-win32.whltokenizers-0.15.0-cp38-none-win_amd64.whltokenizers-0.15.0-cp39-none-win32.whltokenizers-0.15.0-cp39-none-win_amd64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-none-win32.whltokenizers-0.15.1-cp310-none-win_amd64.whltokenizers-0.15.1-cp311-none-win32.whltokenizers-0.15.1-cp311-none-win_amd64.whltokenizers-0.15.1-cp312-none-win32.whltokenizers-0.15.1-cp312-none-win_amd64.whltokenizers-0.15.1-cp37-none-win32.whltokenizers-0.15.1-cp37-none-win_amd64.whltokenizers-0.15.1-cp38-none-win32.whltokenizers-0.15.1-cp38-none-win_amd64.whltokenizers-0.15.1-cp39-none-win32.whltokenizers-0.15.1-cp39-none-win_amd64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-none-win32.whltokenizers-0.15.2-cp310-none-win_amd64.whltokenizers-0.15.2-cp311-none-win32.whltokenizers-0.15.2-cp311-none-win_amd64.whltokenizers-0.15.2-cp312-none-win32.whltokenizers-0.15.2-cp312-none-win_amd64.whltokenizers-0.15.2-cp37-none-win32.whltokenizers-0.15.2-cp37-none-win_amd64.whltokenizers-0.15.2-cp38-none-win32.whltokenizers-0.15.2-cp38-none-win_amd64.whltokenizers-0.15.2-cp39-none-win32.whltokenizers-0.15.2-cp39-none-win_amd64.whl
b32357a10657d49b48f14d40f574837288a1945ddb20655354de77609f37a55e
3679 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp38-cp38-macosx_12_0_arm64.whl - tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.3-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.3-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl - tokenizers
0.14.0
tokenizers-0.14.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.15.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
fdcc5b3aa4cdedf58d6ad61791c8eb29deea16d9601ca6c1d40230d6956dc6b5
3726 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-win32.whltokenizers-0.13.2-cp310-cp310-win_amd64.whltokenizers-0.13.2-cp311-cp311-win32.whltokenizers-0.13.2-cp311-cp311-win_amd64.whltokenizers-0.13.2-cp37-cp37m-win32.whltokenizers-0.13.2-cp37-cp37m-win_amd64.whltokenizers-0.13.2-cp38-cp38-win32.whltokenizers-0.13.2-cp38-cp38-win_amd64.whltokenizers-0.13.2-cp39-cp39-win32.whltokenizers-0.13.2-cp39-cp39-win_amd64.whl
232fa913e1d433f4e1ee2060e3f187f44020b2e51f140a975dfe50aabb23c14a
3624 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.2-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.2-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
7ac3660ad6ab9c7fe8fa0b995d7099302dc86b088f71e94c75c9fd076a8f929d
3808 bytes
- tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-win32.whltokenizers-0.12.0-cp310-cp310-win_amd64.whltokenizers-0.12.0-cp37-cp37m-win32.whltokenizers-0.12.0-cp37-cp37m-win_amd64.whltokenizers-0.12.0-cp38-cp38-win32.whltokenizers-0.12.0-cp38-cp38-win_amd64.whltokenizers-0.12.0-cp39-cp39-win32.whltokenizers-0.12.0-cp39-cp39-win_amd64.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-win32.whltokenizers-0.12.1-cp310-cp310-win_amd64.whltokenizers-0.12.1-cp37-cp37m-win32.whltokenizers-0.12.1-cp37-cp37m-win_amd64.whltokenizers-0.12.1-cp38-cp38-win32.whltokenizers-0.12.1-cp38-cp38-win_amd64.whltokenizers-0.12.1-cp39-cp39-win32.whltokenizers-0.12.1-cp39-cp39-win_amd64.whl - tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-win32.whltokenizers-0.13.0-cp310-cp310-win_amd64.whltokenizers-0.13.0-cp37-cp37m-win32.whltokenizers-0.13.0-cp37-cp37m-win_amd64.whltokenizers-0.13.0-cp38-cp38-win32.whltokenizers-0.13.0-cp38-cp38-win_amd64.whltokenizers-0.13.0-cp39-cp39-win32.whltokenizers-0.13.0-cp39-cp39-win_amd64.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-win32.whltokenizers-0.13.1-cp310-cp310-win_amd64.whltokenizers-0.13.1-cp37-cp37m-win32.whltokenizers-0.13.1-cp37-cp37m-win_amd64.whltokenizers-0.13.1-cp38-cp38-win32.whltokenizers-0.13.1-cp38-cp38-win_amd64.whltokenizers-0.13.1-cp39-cp39-win32.whltokenizers-0.13.1-cp39-cp39-win_amd64.whl
77811dc2268cee3928d2b37c8d900d61f7d9a61877355130e49ea7c15716523a
3701 bytes
- tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.0-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.0-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.1-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
5bfb5c8e6e0a2023b57532139f810719c34309637643148c9c805e05b4f43cd9
3703 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-win32.whltokenizers-0.10.0-cp35-cp35m-win_amd64.whltokenizers-0.10.0-cp36-cp36m-win32.whltokenizers-0.10.0-cp36-cp36m-win_amd64.whltokenizers-0.10.0-cp37-cp37m-win32.whltokenizers-0.10.0-cp37-cp37m-win_amd64.whltokenizers-0.10.0-cp38-cp38-win32.whltokenizers-0.10.0-cp38-cp38-win_amd64.whltokenizers-0.10.0-cp39-cp39-win32.whltokenizers-0.10.0-cp39-cp39-win_amd64.whl - tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-win32.whltokenizers-0.10.1-cp35-cp35m-win_amd64.whltokenizers-0.10.1-cp36-cp36m-win32.whltokenizers-0.10.1-cp36-cp36m-win_amd64.whltokenizers-0.10.1-cp37-cp37m-win32.whltokenizers-0.10.1-cp37-cp37m-win_amd64.whltokenizers-0.10.1-cp38-cp38-win32.whltokenizers-0.10.1-cp38-cp38-win_amd64.whltokenizers-0.10.1-cp39-cp39-win32.whltokenizers-0.10.1-cp39-cp39-win_amd64.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-win32.whltokenizers-0.10.2-cp35-cp35m-win_amd64.whltokenizers-0.10.2-cp36-cp36m-win32.whltokenizers-0.10.2-cp36-cp36m-win_amd64.whltokenizers-0.10.2-cp37-cp37m-win32.whltokenizers-0.10.2-cp37-cp37m-win_amd64.whltokenizers-0.10.2-cp38-cp38-win32.whltokenizers-0.10.2-cp38-cp38-win_amd64.whltokenizers-0.10.2-cp39-cp39-win32.whltokenizers-0.10.2-cp39-cp39-win_amd64.whl - tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-win32.whltokenizers-0.10.3-cp36-cp36m-win_amd64.whltokenizers-0.10.3-cp37-cp37m-win32.whltokenizers-0.10.3-cp37-cp37m-win_amd64.whltokenizers-0.10.3-cp38-cp38-win32.whltokenizers-0.10.3-cp38-cp38-win_amd64.whltokenizers-0.10.3-cp39-cp39-win32.whltokenizers-0.10.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.0
tokenizers-0.11.0-cp37-cp37m-win32.whltokenizers-0.11.0-cp37-cp37m-win_amd64.whltokenizers-0.11.0-cp38-cp38-win32.whltokenizers-0.11.0-cp38-cp38-win_amd64.whltokenizers-0.11.0-cp39-cp39-win32.whltokenizers-0.11.0-cp39-cp39-win_amd64.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp37-cp37m-win32.whltokenizers-0.11.1-cp37-cp37m-win_amd64.whltokenizers-0.11.1-cp38-cp38-win32.whltokenizers-0.11.1-cp38-cp38-win_amd64.whltokenizers-0.11.1-cp39-cp39-win32.whltokenizers-0.11.1-cp39-cp39-win_amd64.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp37-cp37m-win32.whltokenizers-0.11.2-cp37-cp37m-win_amd64.whltokenizers-0.11.2-cp38-cp38-win32.whltokenizers-0.11.2-cp38-cp38-win_amd64.whltokenizers-0.11.2-cp39-cp39-win32.whltokenizers-0.11.2-cp39-cp39-win_amd64.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-win32.whltokenizers-0.11.3-cp310-cp310-win_amd64.whltokenizers-0.11.3-cp37-cp37m-win32.whltokenizers-0.11.3-cp37-cp37m-win_amd64.whltokenizers-0.11.3-cp38-cp38-win32.whltokenizers-0.11.3-cp38-cp38-win_amd64.whltokenizers-0.11.3-cp39-cp39-win32.whltokenizers-0.11.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-win32.whltokenizers-0.11.4-cp310-cp310-win_amd64.whltokenizers-0.11.4-cp37-cp37m-win32.whltokenizers-0.11.4-cp37-cp37m-win_amd64.whltokenizers-0.11.4-cp38-cp38-win32.whltokenizers-0.11.4-cp38-cp38-win_amd64.whltokenizers-0.11.4-cp39-cp39-win32.whltokenizers-0.11.4-cp39-cp39-win_amd64.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-win32.whltokenizers-0.11.5-cp310-cp310-win_amd64.whltokenizers-0.11.5-cp37-cp37m-win32.whltokenizers-0.11.5-cp37-cp37m-win_amd64.whltokenizers-0.11.5-cp38-cp38-win32.whltokenizers-0.11.5-cp38-cp38-win_amd64.whltokenizers-0.11.5-cp39-cp39-win32.whltokenizers-0.11.5-cp39-cp39-win_amd64.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-win32.whltokenizers-0.11.6-cp310-cp310-win_amd64.whltokenizers-0.11.6-cp37-cp37m-win32.whltokenizers-0.11.6-cp37-cp37m-win_amd64.whltokenizers-0.11.6-cp38-cp38-win32.whltokenizers-0.11.6-cp38-cp38-win_amd64.whltokenizers-0.11.6-cp39-cp39-win32.whltokenizers-0.11.6-cp39-cp39-win_amd64.whl
ee1fa9e9d96e03fdf0b45d72aa28bb077314efc1ca3f7f4c0102d385ec06a58a
3601 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.0-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.0-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.0-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.0-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.0-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.1-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.1-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.1-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.1-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.2-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.2-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.2-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.2-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl - tokenizers
0.11.0
tokenizers-0.11.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.6-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp36-cp36m-macosx_12_0_arm64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.6-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.6-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.11.6-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
be69eb36b23c62b4a9b6fd9251b0770aecc28290f13d5630e1fe87f01266313b
2788 bytes
- tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-win32.whltokenizers-0.10.0rc1-cp35-cp35m-win_amd64.whltokenizers-0.10.0rc1-cp36-cp36m-win32.whltokenizers-0.10.0rc1-cp36-cp36m-win_amd64.whltokenizers-0.10.0rc1-cp37-cp37m-win32.whltokenizers-0.10.0rc1-cp37-cp37m-win_amd64.whltokenizers-0.10.0rc1-cp38-cp38-win32.whltokenizers-0.10.0rc1-cp38-cp38-win_amd64.whltokenizers-0.10.0rc1-cp39-cp39-win32.whltokenizers-0.10.0rc1-cp39-cp39-win_amd64.whl
e9f1ad205d3e478f151b89fc064b2e32aee8d064405e787e25efc8a6deff6d0c
2711 bytes
- tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_s390x.whl
45934e41c7872d6029e0d73b19e8f1129e79f2a29ef0ff34cdbc7db89c0f0544
2780 bytes
- tokenizers
0.9.3
tokenizers-0.9.3-cp35-cp35m-win32.whltokenizers-0.9.3-cp35-cp35m-win_amd64.whltokenizers-0.9.3-cp36-cp36m-win32.whltokenizers-0.9.3-cp36-cp36m-win_amd64.whltokenizers-0.9.3-cp37-cp37m-win32.whltokenizers-0.9.3-cp37-cp37m-win_amd64.whltokenizers-0.9.3-cp38-cp38-win32.whltokenizers-0.9.3-cp38-cp38-win_amd64.whl - tokenizers
0.9.4
tokenizers-0.9.4-cp35-cp35m-win32.whltokenizers-0.9.4-cp35-cp35m-win_amd64.whltokenizers-0.9.4-cp36-cp36m-win32.whltokenizers-0.9.4-cp36-cp36m-win_amd64.whltokenizers-0.9.4-cp37-cp37m-win32.whltokenizers-0.9.4-cp37-cp37m-win_amd64.whltokenizers-0.9.4-cp38-cp38-win32.whltokenizers-0.9.4-cp38-cp38-win_amd64.whltokenizers-0.9.4-cp39-cp39-win32.whltokenizers-0.9.4-cp39-cp39-win_amd64.whl
21df33d2793a56dd57fa1c7dca66cd0d02f4d78a472f90246a15f92ebfaee469
2703 bytes
- tokenizers
0.9.4
tokenizers-0.9.4-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.9.4-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.9.4-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.4-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.9.4-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.9.4-cp38-cp38-manylinux1_x86_64.whltokenizers-0.9.4-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.9.4-cp38-cp38-manylinux2014_s390x.whltokenizers-0.9.4-cp39-cp39-manylinux1_x86_64.whltokenizers-0.9.4-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.9.4-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.9.4-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.9.4-cp39-cp39-manylinux2014_s390x.whl