tokenizers/implementations/bert_wordpiece.py
29 distinct file contents recorded under this name ยท 2000 PyPI records
This name has more records than one lookup returns; counts here are a floor, not a total.
Python source file Reference
A .py file contains Python source code in plain text. The Python interpreter reads the file and runs the code directly, without a separate compile step. Developers write scripts, modules, and full programs in this format. A text editor can open and change the file. Python is one of the most used programming languages, thus .py files are common on many systems.
A file extension is only a part of the file name. It does not give a guarantee about the format or the content of a file. But on Windows, the extension selects the program that opens the file.
Hashes for this file
b0a0ae9b414a3d875280914937c2c37ab541a130d14aacaa49dadc9be96f42a2
5520 bytes
- tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.3-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.3-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl - tokenizers
0.14.0
tokenizers-0.14.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.15.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.19.0
tokenizers-0.19.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.1
tokenizers-0.20.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whl - tokenizers
0.20.2
tokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whl
685a280cabd5d5b5f6383654724f4745a024537e856c35a62eafb55de66eb92c
5673 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-win32.whltokenizers-0.13.2-cp310-cp310-win_amd64.whltokenizers-0.13.2-cp311-cp311-win32.whltokenizers-0.13.2-cp311-cp311-win_amd64.whltokenizers-0.13.2-cp37-cp37m-win32.whltokenizers-0.13.2-cp37-cp37m-win_amd64.whltokenizers-0.13.2-cp38-cp38-win32.whltokenizers-0.13.2-cp38-cp38-win_amd64.whltokenizers-0.13.2-cp39-cp39-win32.whltokenizers-0.13.2-cp39-cp39-win_amd64.whl
80eb505dbb6c3a042b008a938495c77916c06d104ba9bce865d1789bd79b7ec3
5521 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.2-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.2-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
1b36b505aa24c25591c089d1f25efb0066d3c0075c3a2ff646e5fc2af4e9fd45
5709 bytes
- tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-win32.whltokenizers-0.12.0-cp310-cp310-win_amd64.whltokenizers-0.12.0-cp37-cp37m-win32.whltokenizers-0.12.0-cp37-cp37m-win_amd64.whltokenizers-0.12.0-cp38-cp38-win32.whltokenizers-0.12.0-cp38-cp38-win_amd64.whltokenizers-0.12.0-cp39-cp39-win32.whltokenizers-0.12.0-cp39-cp39-win_amd64.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-win32.whltokenizers-0.12.1-cp310-cp310-win_amd64.whltokenizers-0.12.1-cp37-cp37m-win32.whltokenizers-0.12.1-cp37-cp37m-win_amd64.whltokenizers-0.12.1-cp38-cp38-win32.whltokenizers-0.12.1-cp38-cp38-win_amd64.whltokenizers-0.12.1-cp39-cp39-win32.whltokenizers-0.12.1-cp39-cp39-win_amd64.whl - tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-win32.whltokenizers-0.13.0-cp310-cp310-win_amd64.whltokenizers-0.13.0-cp37-cp37m-win32.whltokenizers-0.13.0-cp37-cp37m-win_amd64.whltokenizers-0.13.0-cp38-cp38-win32.whltokenizers-0.13.0-cp38-cp38-win_amd64.whltokenizers-0.13.0-cp39-cp39-win32.whltokenizers-0.13.0-cp39-cp39-win_amd64.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-win32.whltokenizers-0.13.1-cp310-cp310-win_amd64.whltokenizers-0.13.1-cp37-cp37m-win32.whltokenizers-0.13.1-cp37-cp37m-win_amd64.whltokenizers-0.13.1-cp38-cp38-win32.whltokenizers-0.13.1-cp38-cp38-win_amd64.whltokenizers-0.13.1-cp39-cp39-win32.whltokenizers-0.13.1-cp39-cp39-win_amd64.whl
4c703f96a3570a0f9bbddc8925b36cddf3927a8c8e4fffb4720834e500f2106c
5556 bytes
- tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.0-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.0-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.1-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
e520c42a2c2454c20aa43949dd34958d7e34e3e6ef56e9701e72a4713864f576
5604 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-win32.whltokenizers-0.10.0-cp35-cp35m-win_amd64.whltokenizers-0.10.0-cp36-cp36m-win32.whltokenizers-0.10.0-cp36-cp36m-win_amd64.whltokenizers-0.10.0-cp37-cp37m-win32.whltokenizers-0.10.0-cp37-cp37m-win_amd64.whltokenizers-0.10.0-cp38-cp38-win32.whltokenizers-0.10.0-cp38-cp38-win_amd64.whltokenizers-0.10.0-cp39-cp39-win32.whltokenizers-0.10.0-cp39-cp39-win_amd64.whl - tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-win32.whltokenizers-0.10.1-cp35-cp35m-win_amd64.whltokenizers-0.10.1-cp36-cp36m-win32.whltokenizers-0.10.1-cp36-cp36m-win_amd64.whltokenizers-0.10.1-cp37-cp37m-win32.whltokenizers-0.10.1-cp37-cp37m-win_amd64.whltokenizers-0.10.1-cp38-cp38-win32.whltokenizers-0.10.1-cp38-cp38-win_amd64.whltokenizers-0.10.1-cp39-cp39-win32.whltokenizers-0.10.1-cp39-cp39-win_amd64.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-win32.whltokenizers-0.10.2-cp35-cp35m-win_amd64.whltokenizers-0.10.2-cp36-cp36m-win32.whltokenizers-0.10.2-cp36-cp36m-win_amd64.whltokenizers-0.10.2-cp37-cp37m-win32.whltokenizers-0.10.2-cp37-cp37m-win_amd64.whltokenizers-0.10.2-cp38-cp38-win32.whltokenizers-0.10.2-cp38-cp38-win_amd64.whltokenizers-0.10.2-cp39-cp39-win32.whltokenizers-0.10.2-cp39-cp39-win_amd64.whl - tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-win32.whltokenizers-0.10.3-cp36-cp36m-win_amd64.whltokenizers-0.10.3-cp37-cp37m-win32.whltokenizers-0.10.3-cp37-cp37m-win_amd64.whltokenizers-0.10.3-cp38-cp38-win32.whltokenizers-0.10.3-cp38-cp38-win_amd64.whltokenizers-0.10.3-cp39-cp39-win32.whltokenizers-0.10.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.0
tokenizers-0.11.0-cp37-cp37m-win32.whltokenizers-0.11.0-cp37-cp37m-win_amd64.whltokenizers-0.11.0-cp38-cp38-win32.whltokenizers-0.11.0-cp38-cp38-win_amd64.whltokenizers-0.11.0-cp39-cp39-win32.whltokenizers-0.11.0-cp39-cp39-win_amd64.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp37-cp37m-win32.whltokenizers-0.11.1-cp37-cp37m-win_amd64.whltokenizers-0.11.1-cp38-cp38-win32.whltokenizers-0.11.1-cp38-cp38-win_amd64.whltokenizers-0.11.1-cp39-cp39-win32.whltokenizers-0.11.1-cp39-cp39-win_amd64.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp37-cp37m-win32.whltokenizers-0.11.2-cp37-cp37m-win_amd64.whltokenizers-0.11.2-cp38-cp38-win32.whltokenizers-0.11.2-cp38-cp38-win_amd64.whltokenizers-0.11.2-cp39-cp39-win32.whltokenizers-0.11.2-cp39-cp39-win_amd64.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-win32.whltokenizers-0.11.3-cp310-cp310-win_amd64.whltokenizers-0.11.3-cp37-cp37m-win32.whltokenizers-0.11.3-cp37-cp37m-win_amd64.whltokenizers-0.11.3-cp38-cp38-win32.whltokenizers-0.11.3-cp38-cp38-win_amd64.whltokenizers-0.11.3-cp39-cp39-win32.whltokenizers-0.11.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-win32.whltokenizers-0.11.4-cp310-cp310-win_amd64.whltokenizers-0.11.4-cp37-cp37m-win32.whltokenizers-0.11.4-cp37-cp37m-win_amd64.whltokenizers-0.11.4-cp38-cp38-win32.whltokenizers-0.11.4-cp38-cp38-win_amd64.whltokenizers-0.11.4-cp39-cp39-win32.whltokenizers-0.11.4-cp39-cp39-win_amd64.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-win32.whltokenizers-0.11.5-cp310-cp310-win_amd64.whltokenizers-0.11.5-cp37-cp37m-win32.whltokenizers-0.11.5-cp37-cp37m-win_amd64.whltokenizers-0.11.5-cp38-cp38-win32.whltokenizers-0.11.5-cp38-cp38-win_amd64.whltokenizers-0.11.5-cp39-cp39-win32.whltokenizers-0.11.5-cp39-cp39-win_amd64.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-win32.whltokenizers-0.11.6-cp310-cp310-win_amd64.whltokenizers-0.11.6-cp37-cp37m-win32.whltokenizers-0.11.6-cp37-cp37m-win_amd64.whltokenizers-0.11.6-cp38-cp38-win32.whltokenizers-0.11.6-cp38-cp38-win_amd64.whltokenizers-0.11.6-cp39-cp39-win32.whltokenizers-0.11.6-cp39-cp39-win_amd64.whl
ff23d6dff05c94cfe0d4e3c8c3c5170ec9bc218f870cf7a8e00d88c379ff9e1d
5456 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.0-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.0-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.0-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.0-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.0-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.1-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.1-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.1-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.1-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.2-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.2-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.2-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.2-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl - tokenizers
0.11.0
tokenizers-0.11.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.6-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp36-cp36m-macosx_12_0_arm64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.6-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.6-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.11.6-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
553d6a5ea2d4aa933f445e986f2324ce06e6568453809cca8229f1aa485cf8d7
4565 bytes
- tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-win32.whltokenizers-0.10.0rc1-cp35-cp35m-win_amd64.whltokenizers-0.10.0rc1-cp36-cp36m-win32.whltokenizers-0.10.0rc1-cp36-cp36m-win_amd64.whltokenizers-0.10.0rc1-cp37-cp37m-win32.whltokenizers-0.10.0rc1-cp37-cp37m-win_amd64.whltokenizers-0.10.0rc1-cp38-cp38-win32.whltokenizers-0.10.0rc1-cp38-cp38-win_amd64.whltokenizers-0.10.0rc1-cp39-cp39-win32.whltokenizers-0.10.0rc1-cp39-cp39-win_amd64.whl
7adac75e12ae05a0c6502612559b81f73a67bdcd398b2ad372a21cdbd3041f33
4447 bytes
- tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_s390x.whl
f710888cb3a718734e72f1f5a290201f9412d9af024ff12dac24c5871ee4bfcf
4557 bytes
- tokenizers
0.9.4
tokenizers-0.9.4-cp35-cp35m-win32.whltokenizers-0.9.4-cp35-cp35m-win_amd64.whltokenizers-0.9.4-cp36-cp36m-win32.whltokenizers-0.9.4-cp36-cp36m-win_amd64.whltokenizers-0.9.4-cp37-cp37m-win32.whltokenizers-0.9.4-cp37-cp37m-win_amd64.whltokenizers-0.9.4-cp38-cp38-win32.whltokenizers-0.9.4-cp38-cp38-win_amd64.whltokenizers-0.9.4-cp39-cp39-win32.whltokenizers-0.9.4-cp39-cp39-win_amd64.whl
f4f24aa0586dd37d68322b46abf0c62abeffbc41161a534210f6907d220705ae
4439 bytes
- tokenizers
0.9.4
tokenizers-0.9.4-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.4-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.4-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.9.4-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.9.4-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.9.4-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.9.4-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.4-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.4-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.9.4-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.9.4-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.9.4-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.9.4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.4-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.4-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.9.4-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.9.4-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.9.4-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.9.4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.4-cp38-cp38-manylinux1_x86_64.whltokenizers-0.9.4-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.9.4-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.9.4-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.9.4-cp38-cp38-manylinux2014_s390x.whltokenizers-0.9.4-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.9.4-cp39-cp39-manylinux1_x86_64.whltokenizers-0.9.4-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.9.4-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.9.4-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.9.4-cp39-cp39-manylinux2014_s390x.whl
355cdcfc2506b52028e2b37ab050e2a52f0262580ac3b6bae66d4b69dbb75ad7
4538 bytes
- tokenizers
0.9.0
tokenizers-0.9.0-cp35-cp35m-win32.whltokenizers-0.9.0-cp35-cp35m-win_amd64.whltokenizers-0.9.0-cp36-cp36m-win32.whltokenizers-0.9.0-cp36-cp36m-win_amd64.whltokenizers-0.9.0-cp37-cp37m-win32.whltokenizers-0.9.0-cp37-cp37m-win_amd64.whltokenizers-0.9.0-cp38-cp38-win32.whltokenizers-0.9.0-cp38-cp38-win_amd64.whl - tokenizers
0.9.0.dev4
tokenizers-0.9.0.dev4-cp35-cp35m-win32.whltokenizers-0.9.0.dev4-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev4-cp36-cp36m-win32.whltokenizers-0.9.0.dev4-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev4-cp37-cp37m-win32.whltokenizers-0.9.0.dev4-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev4-cp38-cp38-win32.whltokenizers-0.9.0.dev4-cp38-cp38-win_amd64.whl - tokenizers
0.9.0rc1
tokenizers-0.9.0rc1-cp35-cp35m-win32.whltokenizers-0.9.0rc1-cp35-cp35m-win_amd64.whltokenizers-0.9.0rc1-cp36-cp36m-win32.whltokenizers-0.9.0rc1-cp36-cp36m-win_amd64.whltokenizers-0.9.0rc1-cp37-cp37m-win32.whltokenizers-0.9.0rc1-cp37-cp37m-win_amd64.whltokenizers-0.9.0rc1-cp38-cp38-win32.whltokenizers-0.9.0rc1-cp38-cp38-win_amd64.whl - tokenizers
0.9.0rc2
tokenizers-0.9.0rc2-cp35-cp35m-win32.whltokenizers-0.9.0rc2-cp35-cp35m-win_amd64.whltokenizers-0.9.0rc2-cp36-cp36m-win32.whltokenizers-0.9.0rc2-cp36-cp36m-win_amd64.whltokenizers-0.9.0rc2-cp37-cp37m-win32.whltokenizers-0.9.0rc2-cp37-cp37m-win_amd64.whltokenizers-0.9.0rc2-cp38-cp38-win32.whltokenizers-0.9.0rc2-cp38-cp38-win_amd64.whl - tokenizers
0.9.1
tokenizers-0.9.1-cp35-cp35m-win32.whltokenizers-0.9.1-cp35-cp35m-win_amd64.whltokenizers-0.9.1-cp36-cp36m-win32.whltokenizers-0.9.1-cp36-cp36m-win_amd64.whltokenizers-0.9.1-cp37-cp37m-win32.whltokenizers-0.9.1-cp37-cp37m-win_amd64.whltokenizers-0.9.1-cp38-cp38-win32.whltokenizers-0.9.1-cp38-cp38-win_amd64.whl - tokenizers
0.9.2
tokenizers-0.9.2-cp35-cp35m-win32.whltokenizers-0.9.2-cp35-cp35m-win_amd64.whltokenizers-0.9.2-cp36-cp36m-win32.whltokenizers-0.9.2-cp36-cp36m-win_amd64.whltokenizers-0.9.2-cp37-cp37m-win32.whltokenizers-0.9.2-cp37-cp37m-win_amd64.whltokenizers-0.9.2-cp38-cp38-win32.whltokenizers-0.9.2-cp38-cp38-win_amd64.whl - tokenizers
0.9.3
tokenizers-0.9.3-cp35-cp35m-win32.whltokenizers-0.9.3-cp35-cp35m-win_amd64.whltokenizers-0.9.3-cp36-cp36m-win32.whltokenizers-0.9.3-cp36-cp36m-win_amd64.whltokenizers-0.9.3-cp37-cp37m-win32.whltokenizers-0.9.3-cp37-cp37m-win_amd64.whltokenizers-0.9.3-cp38-cp38-win32.whltokenizers-0.9.3-cp38-cp38-win_amd64.whl
c16443d26707844172315d016c18c43c4eae9ed28ba522c934a100bfe59f72e0
4421 bytes
- tokenizers
0.9.0
tokenizers-0.9.0-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0.dev4
tokenizers-0.9.0.dev4-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev4-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev4-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev4-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev4-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev4-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0rc1
tokenizers-0.9.0rc1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0rc1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0rc1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0rc1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0rc1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0rc1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0rc1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0rc1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0rc2
tokenizers-0.9.0rc2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0rc2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0rc2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0rc2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0rc2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0rc2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0rc2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0rc2-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.1
tokenizers-0.9.1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.2
tokenizers-0.9.2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.2-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.3
tokenizers-0.9.3-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.3-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.3-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.3-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.3-cp38-cp38-manylinux1_x86_64.whl
7973bcd7e8a4576f8d56e66d1bbdfddacfcaf913ab820446dd4037436e48c5fc
4385 bytes
- tokenizers
0.8.1
tokenizers-0.8.1-cp35-cp35m-win32.whltokenizers-0.8.1-cp35-cp35m-win_amd64.whltokenizers-0.8.1-cp36-cp36m-win32.whltokenizers-0.8.1-cp36-cp36m-win_amd64.whltokenizers-0.8.1-cp37-cp37m-win32.whltokenizers-0.8.1-cp37-cp37m-win_amd64.whltokenizers-0.8.1-cp38-cp38-win32.whltokenizers-0.8.1-cp38-cp38-win_amd64.whl - tokenizers
0.8.1rc1
tokenizers-0.8.1rc1-cp35-cp35m-win32.whltokenizers-0.8.1rc1-cp35-cp35m-win_amd64.whltokenizers-0.8.1rc1-cp36-cp36m-win32.whltokenizers-0.8.1rc1-cp36-cp36m-win_amd64.whltokenizers-0.8.1rc1-cp37-cp37m-win32.whltokenizers-0.8.1rc1-cp37-cp37m-win_amd64.whltokenizers-0.8.1rc1-cp38-cp38-win32.whltokenizers-0.8.1rc1-cp38-cp38-win_amd64.whl - tokenizers
0.8.1rc2
tokenizers-0.8.1rc2-cp35-cp35m-win32.whltokenizers-0.8.1rc2-cp35-cp35m-win_amd64.whltokenizers-0.8.1rc2-cp36-cp36m-win32.whltokenizers-0.8.1rc2-cp36-cp36m-win_amd64.whltokenizers-0.8.1rc2-cp37-cp37m-win32.whltokenizers-0.8.1rc2-cp37-cp37m-win_amd64.whltokenizers-0.8.1rc2-cp38-cp38-win32.whltokenizers-0.8.1rc2-cp38-cp38-win_amd64.whl - tokenizers
0.9.0.dev0
tokenizers-0.9.0.dev0-cp35-cp35m-win32.whltokenizers-0.9.0.dev0-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev0-cp36-cp36m-win32.whltokenizers-0.9.0.dev0-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev0-cp37-cp37m-win32.whltokenizers-0.9.0.dev0-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev0-cp38-cp38-win32.whltokenizers-0.9.0.dev0-cp38-cp38-win_amd64.whl - tokenizers
0.9.0.dev1
tokenizers-0.9.0.dev1-cp35-cp35m-win32.whltokenizers-0.9.0.dev1-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev1-cp36-cp36m-win32.whltokenizers-0.9.0.dev1-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev1-cp37-cp37m-win32.whltokenizers-0.9.0.dev1-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev1-cp38-cp38-win32.whltokenizers-0.9.0.dev1-cp38-cp38-win_amd64.whl - tokenizers
0.9.0.dev2
tokenizers-0.9.0.dev2-cp35-cp35m-win32.whltokenizers-0.9.0.dev2-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev2-cp36-cp36m-win32.whltokenizers-0.9.0.dev2-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev2-cp37-cp37m-win32.whltokenizers-0.9.0.dev2-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev2-cp38-cp38-win32.whltokenizers-0.9.0.dev2-cp38-cp38-win_amd64.whl - tokenizers
0.9.0.dev3
tokenizers-0.9.0.dev3-cp35-cp35m-win32.whltokenizers-0.9.0.dev3-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev3-cp36-cp36m-win32.whltokenizers-0.9.0.dev3-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev3-cp37-cp37m-win32.whltokenizers-0.9.0.dev3-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev3-cp38-cp38-win32.whltokenizers-0.9.0.dev3-cp38-cp38-win_amd64.whl
f11c3bc68744892eed9ab88b0e7796e3c6742ad01b7ab7d8c53f91e04bc85055
4272 bytes
- tokenizers
0.8.1
tokenizers-0.8.1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.8.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.8.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.8.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.8.1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.1rc1
tokenizers-0.8.1rc1-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.8.1rc1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.1rc1-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.8.1rc1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.1rc1-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.8.1rc1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.1rc1-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.8.1rc1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.1rc2
tokenizers-0.8.1rc2-cp35-cp35m-macosx_10_14_x86_64.whltokenizers-0.8.1rc2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.1rc2-cp36-cp36m-macosx_10_14_x86_64.whltokenizers-0.8.1rc2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.1rc2-cp37-cp37m-macosx_10_14_x86_64.whltokenizers-0.8.1rc2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.1rc2-cp38-cp38-macosx_10_14_x86_64.whltokenizers-0.8.1rc2-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0.dev0
tokenizers-0.9.0.dev0-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev0-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0.dev1
tokenizers-0.9.0.dev1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0.dev2
tokenizers-0.9.0.dev2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev2-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0.dev3
tokenizers-0.9.0.dev3-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev3-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev3-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev3-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev3-cp38-cp38-manylinux1_x86_64.whl
a2331b7eb3da997d929f756b9feaa98415185554f3c3c5f727d5139d435db49b
4351 bytes
- tokenizers
0.7.0
tokenizers-0.7.0-cp35-cp35m-win32.whltokenizers-0.7.0-cp35-cp35m-win_amd64.whltokenizers-0.7.0-cp36-cp36m-win32.whltokenizers-0.7.0-cp36-cp36m-win_amd64.whltokenizers-0.7.0-cp37-cp37m-win32.whltokenizers-0.7.0-cp37-cp37m-win_amd64.whltokenizers-0.7.0-cp38-cp38-win32.whltokenizers-0.7.0-cp38-cp38-win_amd64.whl - tokenizers
0.7.0rc4
tokenizers-0.7.0rc4-cp35-cp35m-win32.whltokenizers-0.7.0rc4-cp35-cp35m-win_amd64.whltokenizers-0.7.0rc4-cp36-cp36m-win32.whltokenizers-0.7.0rc4-cp36-cp36m-win_amd64.whltokenizers-0.7.0rc4-cp37-cp37m-win32.whltokenizers-0.7.0rc4-cp37-cp37m-win_amd64.whltokenizers-0.7.0rc4-cp38-cp38-win32.whltokenizers-0.7.0rc4-cp38-cp38-win_amd64.whl - tokenizers
0.7.0rc5
tokenizers-0.7.0rc5-cp35-cp35m-win32.whltokenizers-0.7.0rc5-cp35-cp35m-win_amd64.whltokenizers-0.7.0rc5-cp36-cp36m-win32.whltokenizers-0.7.0rc5-cp36-cp36m-win_amd64.whltokenizers-0.7.0rc5-cp37-cp37m-win32.whltokenizers-0.7.0rc5-cp37-cp37m-win_amd64.whltokenizers-0.7.0rc5-cp38-cp38-win32.whltokenizers-0.7.0rc5-cp38-cp38-win_amd64.whl - tokenizers
0.7.0rc6
tokenizers-0.7.0rc6-cp35-cp35m-win32.whltokenizers-0.7.0rc6-cp35-cp35m-win_amd64.whltokenizers-0.7.0rc6-cp36-cp36m-win32.whltokenizers-0.7.0rc6-cp36-cp36m-win_amd64.whltokenizers-0.7.0rc6-cp37-cp37m-win32.whltokenizers-0.7.0rc6-cp37-cp37m-win_amd64.whltokenizers-0.7.0rc6-cp38-cp38-win32.whltokenizers-0.7.0rc6-cp38-cp38-win_amd64.whl - tokenizers
0.7.0rc7
tokenizers-0.7.0rc7-cp35-cp35m-win32.whltokenizers-0.7.0rc7-cp35-cp35m-win_amd64.whltokenizers-0.7.0rc7-cp36-cp36m-win32.whltokenizers-0.7.0rc7-cp36-cp36m-win_amd64.whltokenizers-0.7.0rc7-cp37-cp37m-win32.whltokenizers-0.7.0rc7-cp37-cp37m-win_amd64.whltokenizers-0.7.0rc7-cp38-cp38-win32.whltokenizers-0.7.0rc7-cp38-cp38-win_amd64.whl - tokenizers
0.8.0
tokenizers-0.8.0-cp35-cp35m-win32.whltokenizers-0.8.0-cp35-cp35m-win_amd64.whltokenizers-0.8.0-cp36-cp36m-win32.whltokenizers-0.8.0-cp36-cp36m-win_amd64.whltokenizers-0.8.0-cp37-cp37m-win32.whltokenizers-0.8.0-cp37-cp37m-win_amd64.whltokenizers-0.8.0-cp38-cp38-win32.whltokenizers-0.8.0-cp38-cp38-win_amd64.whl - tokenizers
0.8.0.dev0
tokenizers-0.8.0.dev0-cp35-cp35m-win32.whltokenizers-0.8.0.dev0-cp35-cp35m-win_amd64.whltokenizers-0.8.0.dev0-cp36-cp36m-win32.whltokenizers-0.8.0.dev0-cp36-cp36m-win_amd64.whltokenizers-0.8.0.dev0-cp37-cp37m-win32.whltokenizers-0.8.0.dev0-cp37-cp37m-win_amd64.whltokenizers-0.8.0.dev0-cp38-cp38-win32.whltokenizers-0.8.0.dev0-cp38-cp38-win_amd64.whl - tokenizers
0.8.0.dev1
tokenizers-0.8.0.dev1-cp35-cp35m-win32.whltokenizers-0.8.0.dev1-cp35-cp35m-win_amd64.whltokenizers-0.8.0.dev1-cp36-cp36m-win32.whltokenizers-0.8.0.dev1-cp36-cp36m-win_amd64.whltokenizers-0.8.0.dev1-cp37-cp37m-win32.whltokenizers-0.8.0.dev1-cp37-cp37m-win_amd64.whltokenizers-0.8.0.dev1-cp38-cp38-win32.whltokenizers-0.8.0.dev1-cp38-cp38-win_amd64.whl - tokenizers
0.8.0.dev2
tokenizers-0.8.0.dev2-cp35-cp35m-win32.whltokenizers-0.8.0.dev2-cp35-cp35m-win_amd64.whltokenizers-0.8.0.dev2-cp36-cp36m-win32.whltokenizers-0.8.0.dev2-cp36-cp36m-win_amd64.whltokenizers-0.8.0.dev2-cp37-cp37m-win32.whltokenizers-0.8.0.dev2-cp37-cp37m-win_amd64.whltokenizers-0.8.0.dev2-cp38-cp38-win32.whltokenizers-0.8.0.dev2-cp38-cp38-win_amd64.whl - tokenizers
0.8.0rc1
tokenizers-0.8.0rc1-cp35-cp35m-win32.whltokenizers-0.8.0rc1-cp35-cp35m-win_amd64.whltokenizers-0.8.0rc1-cp36-cp36m-win32.whltokenizers-0.8.0rc1-cp36-cp36m-win_amd64.whltokenizers-0.8.0rc1-cp37-cp37m-win32.whltokenizers-0.8.0rc1-cp37-cp37m-win_amd64.whltokenizers-0.8.0rc1-cp38-cp38-win32.whltokenizers-0.8.0rc1-cp38-cp38-win_amd64.whl - tokenizers
0.8.0rc2
tokenizers-0.8.0rc2-cp35-cp35m-win32.whltokenizers-0.8.0rc2-cp35-cp35m-win_amd64.whltokenizers-0.8.0rc2-cp36-cp36m-win32.whltokenizers-0.8.0rc2-cp36-cp36m-win_amd64.whltokenizers-0.8.0rc2-cp37-cp37m-win32.whltokenizers-0.8.0rc2-cp37-cp37m-win_amd64.whltokenizers-0.8.0rc2-cp38-cp38-win32.whltokenizers-0.8.0rc2-cp38-cp38-win_amd64.whl - tokenizers
0.8.0rc3
tokenizers-0.8.0rc3-cp35-cp35m-win32.whltokenizers-0.8.0rc3-cp35-cp35m-win_amd64.whltokenizers-0.8.0rc3-cp36-cp36m-win32.whltokenizers-0.8.0rc3-cp36-cp36m-win_amd64.whltokenizers-0.8.0rc3-cp37-cp37m-win32.whltokenizers-0.8.0rc3-cp37-cp37m-win_amd64.whltokenizers-0.8.0rc3-cp38-cp38-win32.whltokenizers-0.8.0rc3-cp38-cp38-win_amd64.whl - and 1 more release view all on the content page
6d611983b6f6a940952d4e535a47f924b567d606c399c583b22130fa5b89813d
4238 bytes
- tokenizers
0.7.0
tokenizers-0.7.0-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.7.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.7.0-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.7.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.7.0-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.7.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.7.0-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.7.0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.7.0rc4
tokenizers-0.7.0rc4-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.7.0rc4-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.7.0rc4-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.7.0rc4-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.7.0rc4-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.7.0rc4-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.7.0rc4-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.7.0rc4-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.7.0rc5
tokenizers-0.7.0rc5-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.7.0rc5-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.7.0rc5-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.7.0rc5-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.7.0rc5-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.7.0rc5-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.7.0rc5-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.7.0rc5-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.7.0rc6
tokenizers-0.7.0rc6-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.7.0rc6-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.7.0rc6-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.7.0rc6-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.7.0rc6-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.7.0rc6-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.7.0rc6-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.7.0rc6-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.7.0rc7
tokenizers-0.7.0rc7-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.7.0rc7-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.7.0rc7-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.7.0rc7-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.7.0rc7-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.7.0rc7-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.7.0rc7-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.7.0rc7-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.0
tokenizers-0.8.0-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.8.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.0-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.8.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.0-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.8.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.0-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.8.0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.0.dev0
tokenizers-0.8.0.dev0-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.0.dev0-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.0.dev0-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.0.dev0-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.8.0.dev0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.0.dev1
tokenizers-0.8.0.dev1-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.0.dev1-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.0.dev1-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.0.dev1-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.8.0.dev1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.0.dev2
tokenizers-0.8.0.dev2-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.0.dev2-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.0.dev2-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.8.0.dev2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.0.dev2-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.8.0.dev2-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.0rc1
tokenizers-0.8.0rc1-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.8.0rc1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.0rc1-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.8.0rc1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.0rc1-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.8.0rc1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.0rc1-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.8.0rc1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.0rc2
tokenizers-0.8.0rc2-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.8.0rc2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.0rc2-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.8.0rc2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.0rc2-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.8.0rc2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.0rc2-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.8.0rc2-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.8.0rc3
tokenizers-0.8.0rc3-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.8.0rc3-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.8.0rc3-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.8.0rc3-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.8.0rc3-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.8.0rc3-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.8.0rc3-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.8.0rc3-cp38-cp38-manylinux1_x86_64.whl - and 1 more release view all on the content page
371b1264dbb9f1dc7ed0d7878bce25be3f29be8a71ac5549c5b12f117033cb5a
4210 bytes
- tokenizers
0.6.0
tokenizers-0.6.0-cp35-cp35m-win32.whltokenizers-0.6.0-cp35-cp35m-win_amd64.whltokenizers-0.6.0-cp36-cp36m-win32.whltokenizers-0.6.0-cp36-cp36m-win_amd64.whltokenizers-0.6.0-cp37-cp37m-win32.whltokenizers-0.6.0-cp37-cp37m-win_amd64.whltokenizers-0.6.0-cp38-cp38-win32.whltokenizers-0.6.0-cp38-cp38-win_amd64.whl
aa3b156b22e45d7961b3e26579934e2da03df3a854bfc65f425930f630ae781a
4101 bytes
- tokenizers
0.6.0
tokenizers-0.6.0-cp35-cp35m-macosx_10_10_x86_64.whltokenizers-0.6.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.6.0-cp36-cp36m-macosx_10_10_x86_64.whltokenizers-0.6.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.6.0-cp37-cp37m-macosx_10_10_x86_64.whltokenizers-0.6.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.6.0-cp38-cp38-macosx_10_10_x86_64.whltokenizers-0.6.0-cp38-cp38-manylinux1_x86_64.whl
649b082870d02d8b31881a19418fafe0eca996e5e5f0a50262f08224cd2b714e
3834 bytes
- tokenizers
0.5.0
tokenizers-0.5.0-cp35-cp35m-win_amd64.whltokenizers-0.5.0-cp36-cp36m-win_amd64.whltokenizers-0.5.0-cp37-cp37m-win_amd64.whltokenizers-0.5.0-cp38-cp38-win_amd64.whl - tokenizers
0.5.1
tokenizers-0.5.1-cp35-cp35m-win_amd64.whltokenizers-0.5.1-cp36-cp36m-win_amd64.whltokenizers-0.5.1-cp37-cp37m-win_amd64.whltokenizers-0.5.1-cp38-cp38-win_amd64.whl - tokenizers
0.5.2
tokenizers-0.5.2-cp35-cp35m-win_amd64.whltokenizers-0.5.2-cp36-cp36m-win_amd64.whltokenizers-0.5.2-cp37-cp37m-win_amd64.whltokenizers-0.5.2-cp38-cp38-win_amd64.whl
dda7dc1f3cfba71ec2b5bddf12818a17ab4f6848c809bd35ee35784b20fcb2fb
3733 bytes
- tokenizers
0.5.0
tokenizers-0.5.0-cp35-cp35m-macosx_10_15_x86_64.whltokenizers-0.5.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.5.0-cp36-cp36m-macosx_10_15_x86_64.whltokenizers-0.5.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.5.0-cp37-cp37m-macosx_10_15_x86_64.whltokenizers-0.5.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.5.0-cp38-cp38-macosx_10_15_x86_64.whltokenizers-0.5.0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.5.1
tokenizers-0.5.1-cp35-cp35m-macosx_10_15_x86_64.whltokenizers-0.5.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.5.1-cp36-cp36m-macosx_10_15_x86_64.whltokenizers-0.5.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.5.1-cp37-cp37m-macosx_10_15_x86_64.whltokenizers-0.5.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.5.1-cp38-cp38-macosx_10_15_x86_64.whltokenizers-0.5.1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.5.2
tokenizers-0.5.2-cp35-cp35m-macosx_10_15_x86_64.whltokenizers-0.5.2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.5.2-cp36-cp36m-macosx_10_15_x86_64.whltokenizers-0.5.2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.5.2-cp37-cp37m-macosx_10_15_x86_64.whltokenizers-0.5.2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.5.2-cp38-cp38-macosx_10_15_x86_64.whltokenizers-0.5.2-cp38-cp38-manylinux1_x86_64.whl
a49478cf8c66a45000eb59e9d78ca4e7d3a4ab528879533f20d3cab4f2d57b68
3482 bytes
- tokenizers
0.4.0
tokenizers-0.4.0-cp35-cp35m-win_amd64.whltokenizers-0.4.0-cp36-cp36m-win_amd64.whltokenizers-0.4.0-cp37-cp37m-win_amd64.whltokenizers-0.4.0-cp38-cp38-win_amd64.whl - tokenizers
0.4.1
tokenizers-0.4.1-cp35-cp35m-win_amd64.whltokenizers-0.4.1-cp36-cp36m-win_amd64.whltokenizers-0.4.1-cp37-cp37m-win_amd64.whltokenizers-0.4.1-cp38-cp38-win_amd64.whl - tokenizers
0.4.2
tokenizers-0.4.2-cp35-cp35m-win_amd64.whltokenizers-0.4.2-cp36-cp36m-win_amd64.whltokenizers-0.4.2-cp37-cp37m-win_amd64.whltokenizers-0.4.2-cp38-cp38-win_amd64.whl
0a5501e5a2b474d668a1e6259ea135e5d249f8e3ed8d7ca507bf8928977d7a7e
3388 bytes
- tokenizers
0.4.0
tokenizers-0.4.0-cp35-cp35m-macosx_10_15_x86_64.whltokenizers-0.4.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.4.0-cp36-cp36m-macosx_10_15_x86_64.whltokenizers-0.4.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.4.0-cp37-cp37m-macosx_10_15_x86_64.whltokenizers-0.4.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.4.0-cp38-cp38-macosx_10_15_x86_64.whltokenizers-0.4.0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.4.1
tokenizers-0.4.1-cp35-cp35m-macosx_10_15_x86_64.whltokenizers-0.4.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.4.1-cp36-cp36m-macosx_10_15_x86_64.whltokenizers-0.4.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.4.1-cp37-cp37m-macosx_10_15_x86_64.whltokenizers-0.4.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.4.1-cp38-cp38-macosx_10_15_x86_64.whltokenizers-0.4.1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.4.2
tokenizers-0.4.2-cp35-cp35m-macosx_10_15_x86_64.whltokenizers-0.4.2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.4.2-cp36-cp36m-macosx_10_15_x86_64.whltokenizers-0.4.2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.4.2-cp37-cp37m-macosx_10_15_x86_64.whltokenizers-0.4.2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.4.2-cp38-cp38-macosx_10_15_x86_64.whltokenizers-0.4.2-cp38-cp38-manylinux1_x86_64.whl
862116a00b7fd430e415ceea92c57fbeb70baeba4d58977604018729767cc2f7
3662 bytes
- tokenizers
0.3.0
tokenizers-0.3.0-cp35-cp35m-win_amd64.whltokenizers-0.3.0-cp36-cp36m-win_amd64.whltokenizers-0.3.0-cp37-cp37m-win_amd64.whltokenizers-0.3.0-cp38-cp38-win_amd64.whl
ab7397409f6119cd0a769fede8c0d740a607d1baccb73f0f97e5ade86575c56a
3575 bytes
- tokenizers
0.3.0
tokenizers-0.3.0-cp35-cp35m-macosx_10_15_x86_64.whltokenizers-0.3.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.3.0-cp36-cp36m-macosx_10_15_x86_64.whltokenizers-0.3.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.3.0-cp37-cp37m-macosx_10_15_x86_64.whltokenizers-0.3.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.3.0-cp38-cp38-macosx_10_15_x86_64.whltokenizers-0.3.0-cp38-cp38-manylinux1_x86_64.whl
4a2b7f1e7036601be81cc944f5e1aa5e6e1aac57b3fa40ccc150c9ad5d6be46d
3568 bytes
- tokenizers
0.1.0
tokenizers-0.1.0-cp35-cp35m-win_amd64.whltokenizers-0.1.0-cp36-cp36m-win_amd64.whltokenizers-0.1.0-cp37-cp37m-win_amd64.whltokenizers-0.1.0-cp38-cp38-win_amd64.whl - tokenizers
0.1.1
tokenizers-0.1.1-cp35-cp35m-win_amd64.whltokenizers-0.1.1-cp36-cp36m-win_amd64.whltokenizers-0.1.1-cp37-cp37m-win_amd64.whltokenizers-0.1.1-cp38-cp38-win_amd64.whl - tokenizers
0.2.0
tokenizers-0.2.0-cp35-cp35m-win_amd64.whltokenizers-0.2.0-cp36-cp36m-win_amd64.whltokenizers-0.2.0-cp37-cp37m-win_amd64.whltokenizers-0.2.0-cp38-cp38-win_amd64.whl - tokenizers
0.2.1
tokenizers-0.2.1-cp35-cp35m-win_amd64.whltokenizers-0.2.1-cp36-cp36m-win_amd64.whltokenizers-0.2.1-cp37-cp37m-win_amd64.whltokenizers-0.2.1-cp38-cp38-win_amd64.whl
d36a676a3a959a6f7166d779c79520283b7dd75f11920094a45583b1e412034f
3482 bytes
- tokenizers
0.1.0
tokenizers-0.1.0-cp35-cp35m-macosx_10_13_x86_64.whltokenizers-0.1.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.1.0-cp36-cp36m-macosx_10_13_x86_64.whltokenizers-0.1.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.1.0-cp37-cp37m-macosx_10_13_x86_64.whltokenizers-0.1.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.1.0-cp38-cp38-macosx_10_13_x86_64.whltokenizers-0.1.0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.1.1
tokenizers-0.1.1-cp35-cp35m-macosx_10_13_x86_64.whltokenizers-0.1.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.1.1-cp36-cp36m-macosx_10_13_x86_64.whltokenizers-0.1.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.1.1-cp37-cp37m-macosx_10_13_x86_64.whltokenizers-0.1.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.1.1-cp38-cp38-macosx_10_13_x86_64.whltokenizers-0.1.1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.2.0
tokenizers-0.2.0-cp35-cp35m-macosx_10_13_x86_64.whltokenizers-0.2.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.2.0-cp36-cp36m-macosx_10_13_x86_64.whltokenizers-0.2.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.2.0-cp37-cp37m-macosx_10_13_x86_64.whltokenizers-0.2.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.2.0-cp38-cp38-macosx_10_13_x86_64.whltokenizers-0.2.0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.2.1
tokenizers-0.2.1-cp35-cp35m-macosx_10_13_x86_64.whltokenizers-0.2.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.2.1-cp36-cp36m-macosx_10_13_x86_64.whltokenizers-0.2.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.2.1-cp37-cp37m-macosx_10_13_x86_64.whltokenizers-0.2.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.2.1-cp38-cp38-macosx_10_13_x86_64.whltokenizers-0.2.1-cp38-cp38-manylinux1_x86_64.whl
90e9b09637e381ccb07c7af4423f9b23d13e6fa7fab9c3f7a5608a1071678ce3
3433 bytes
- tokenizers
0.0.13
tokenizers-0.0.13-cp35-cp35m-win_amd64.whltokenizers-0.0.13-cp36-cp36m-win_amd64.whltokenizers-0.0.13-cp37-cp37m-win_amd64.whltokenizers-0.0.13-cp38-cp38-win_amd64.whl
922167514a03eb28e737e680bf54d4b189cbab17cb2fbfc74dc12247a45000b1
3349 bytes
- tokenizers
0.0.13
tokenizers-0.0.13-cp35-cp35m-macosx_10_13_x86_64.whltokenizers-0.0.13-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.0.13-cp36-cp36m-macosx_10_13_x86_64.whltokenizers-0.0.13-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.0.13-cp37-cp37m-macosx_10_13_x86_64.whltokenizers-0.0.13-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.0.13-cp38-cp38-macosx_10_13_x86_64.whltokenizers-0.0.13-cp38-cp38-manylinux1_x86_64.whl