tokenizers/implementations/sentencepiece_unigram.py
26 distinct file contents recorded under this name ยท 2000 PyPI records
This name has more records than one lookup returns; counts here are a floor, not a total.
Python source file Reference
A .py file contains Python source code in plain text. The Python interpreter reads the file and runs the code directly, without a separate compile step. Developers write scripts, modules, and full programs in this format. A text editor can open and change the file. Python is one of the most used programming languages, thus .py files are common on many systems.
A file extension is only a part of the file name. It does not give a guarantee about the format or the content of a file. But on Windows, the extension selects the program that opens the file.
Hashes for this file
e529623d0b14fdc001d4faadeee7cbf70f1f06b3682e2c550beaea178311726d
7776 bytes
- tokenizers
0.19.0
tokenizers-0.19.0-cp310-none-win32.whltokenizers-0.19.0-cp310-none-win_amd64.whltokenizers-0.19.0-cp311-none-win32.whltokenizers-0.19.0-cp311-none-win_amd64.whltokenizers-0.19.0-cp312-none-win32.whltokenizers-0.19.0-cp312-none-win_amd64.whltokenizers-0.19.0-cp37-none-win32.whltokenizers-0.19.0-cp37-none-win_amd64.whltokenizers-0.19.0-cp38-none-win32.whltokenizers-0.19.0-cp38-none-win_amd64.whltokenizers-0.19.0-cp39-none-win32.whltokenizers-0.19.0-cp39-none-win_amd64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-none-win32.whltokenizers-0.19.1-cp310-none-win_amd64.whltokenizers-0.19.1-cp311-none-win32.whltokenizers-0.19.1-cp311-none-win_amd64.whltokenizers-0.19.1-cp312-none-win32.whltokenizers-0.19.1-cp312-none-win_amd64.whltokenizers-0.19.1-cp37-none-win_amd64.whltokenizers-0.19.1-cp38-none-win_amd64.whltokenizers-0.19.1-cp39-none-win_amd64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-none-win_amd64.whltokenizers-0.20.0-cp311-none-win_amd64.whl
4988955cbf19b6a2d72a9baac27c26adfc601a8b6ef320243aeedd2f3b445c8a
7580 bytes
- tokenizers
0.19.0
tokenizers-0.19.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.1
tokenizers-0.20.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.2
tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.3
tokenizers-0.20.3-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.3-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.3-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.3-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.20.3-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.3-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.3-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.3-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.4
tokenizers-0.20.4-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.20.4-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.20.4rc0
tokenizers-0.20.4rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.20.4rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.0
tokenizers-0.21.0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.0rc0
tokenizers-0.21.0rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.0rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.1
tokenizers-0.21.1-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.1-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.1rc0
tokenizers-0.21.1rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.1rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_x86_64.whl - and 7 more releases view all on the content page
9c4b2c70444d593f99744107f6892dd7b8ec52887f6b0047661113cf786d987c
7656 bytes
- tokenizers
0.14.0
tokenizers-0.14.0-cp310-none-win32.whltokenizers-0.14.0-cp310-none-win_amd64.whltokenizers-0.14.0-cp311-none-win32.whltokenizers-0.14.0-cp311-none-win_amd64.whltokenizers-0.14.0-cp37-none-win32.whltokenizers-0.14.0-cp37-none-win_amd64.whltokenizers-0.14.0-cp38-none-win32.whltokenizers-0.14.0-cp38-none-win_amd64.whltokenizers-0.14.0-cp39-none-win32.whltokenizers-0.14.0-cp39-none-win_amd64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-none-win32.whltokenizers-0.14.1-cp310-none-win_amd64.whltokenizers-0.14.1-cp311-none-win32.whltokenizers-0.14.1-cp311-none-win_amd64.whltokenizers-0.14.1-cp37-none-win32.whltokenizers-0.14.1-cp37-none-win_amd64.whltokenizers-0.14.1-cp38-none-win32.whltokenizers-0.14.1-cp38-none-win_amd64.whltokenizers-0.14.1-cp39-none-win32.whltokenizers-0.14.1-cp39-none-win_amd64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-none-win32.whltokenizers-0.15.0-cp310-none-win_amd64.whltokenizers-0.15.0-cp311-none-win32.whltokenizers-0.15.0-cp311-none-win_amd64.whltokenizers-0.15.0-cp37-none-win32.whltokenizers-0.15.0-cp37-none-win_amd64.whltokenizers-0.15.0-cp38-none-win32.whltokenizers-0.15.0-cp38-none-win_amd64.whltokenizers-0.15.0-cp39-none-win32.whltokenizers-0.15.0-cp39-none-win_amd64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-none-win32.whltokenizers-0.15.1-cp310-none-win_amd64.whltokenizers-0.15.1-cp311-none-win32.whltokenizers-0.15.1-cp311-none-win_amd64.whltokenizers-0.15.1-cp312-none-win32.whltokenizers-0.15.1-cp312-none-win_amd64.whltokenizers-0.15.1-cp37-none-win32.whltokenizers-0.15.1-cp37-none-win_amd64.whltokenizers-0.15.1-cp38-none-win32.whltokenizers-0.15.1-cp38-none-win_amd64.whltokenizers-0.15.1-cp39-none-win32.whltokenizers-0.15.1-cp39-none-win_amd64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-none-win32.whltokenizers-0.15.2-cp310-none-win_amd64.whltokenizers-0.15.2-cp311-none-win32.whltokenizers-0.15.2-cp311-none-win_amd64.whltokenizers-0.15.2-cp312-none-win32.whltokenizers-0.15.2-cp312-none-win_amd64.whltokenizers-0.15.2-cp37-none-win32.whltokenizers-0.15.2-cp37-none-win_amd64.whltokenizers-0.15.2-cp38-none-win32.whltokenizers-0.15.2-cp38-none-win_amd64.whltokenizers-0.15.2-cp39-none-win32.whltokenizers-0.15.2-cp39-none-win_amd64.whl
8827fd34a3c0c5359f3469b0c74028a00d6e6cde386c081376f8d4ecb867be13
7462 bytes
- tokenizers
0.14.0
tokenizers-0.14.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.15.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
9c4943f61c7bc9685a526cdf058140da0800450bb81ea376c720eec7ca731637
7386 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-win32.whltokenizers-0.13.2-cp310-cp310-win_amd64.whltokenizers-0.13.2-cp311-cp311-win32.whltokenizers-0.13.2-cp311-cp311-win_amd64.whltokenizers-0.13.2-cp37-cp37m-win32.whltokenizers-0.13.2-cp37-cp37m-win_amd64.whltokenizers-0.13.2-cp38-cp38-win32.whltokenizers-0.13.2-cp38-cp38-win_amd64.whltokenizers-0.13.2-cp39-cp39-win32.whltokenizers-0.13.2-cp39-cp39-win_amd64.whl - tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-win32.whltokenizers-0.13.3-cp310-cp310-win_amd64.whltokenizers-0.13.3-cp311-cp311-win32.whltokenizers-0.13.3-cp311-cp311-win_amd64.whltokenizers-0.13.3-cp37-cp37m-win32.whltokenizers-0.13.3-cp37-cp37m-win_amd64.whltokenizers-0.13.3-cp38-cp38-win32.whltokenizers-0.13.3-cp38-cp38-win_amd64.whltokenizers-0.13.3-cp39-cp39-win32.whltokenizers-0.13.3-cp39-cp39-win_amd64.whl
e83e1dfa97f941cec876d5ef9c0f439ae41b0ff5b9198b15bc4885ff5f166d21
7196 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.2-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.2-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl - tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.3-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.3-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
1938d44db0c58bce04f41d741de0236106ca234f4c46d3e656997ab3045d9893
7480 bytes
- tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-win32.whltokenizers-0.12.0-cp310-cp310-win_amd64.whltokenizers-0.12.0-cp37-cp37m-win32.whltokenizers-0.12.0-cp37-cp37m-win_amd64.whltokenizers-0.12.0-cp38-cp38-win32.whltokenizers-0.12.0-cp38-cp38-win_amd64.whltokenizers-0.12.0-cp39-cp39-win32.whltokenizers-0.12.0-cp39-cp39-win_amd64.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-win32.whltokenizers-0.12.1-cp310-cp310-win_amd64.whltokenizers-0.12.1-cp37-cp37m-win32.whltokenizers-0.12.1-cp37-cp37m-win_amd64.whltokenizers-0.12.1-cp38-cp38-win32.whltokenizers-0.12.1-cp38-cp38-win_amd64.whltokenizers-0.12.1-cp39-cp39-win32.whltokenizers-0.12.1-cp39-cp39-win_amd64.whl - tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-win32.whltokenizers-0.13.0-cp310-cp310-win_amd64.whltokenizers-0.13.0-cp37-cp37m-win32.whltokenizers-0.13.0-cp37-cp37m-win_amd64.whltokenizers-0.13.0-cp38-cp38-win32.whltokenizers-0.13.0-cp38-cp38-win_amd64.whltokenizers-0.13.0-cp39-cp39-win32.whltokenizers-0.13.0-cp39-cp39-win_amd64.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-win32.whltokenizers-0.13.1-cp310-cp310-win_amd64.whltokenizers-0.13.1-cp37-cp37m-win32.whltokenizers-0.13.1-cp37-cp37m-win_amd64.whltokenizers-0.13.1-cp38-cp38-win32.whltokenizers-0.13.1-cp38-cp38-win_amd64.whltokenizers-0.13.1-cp39-cp39-win32.whltokenizers-0.13.1-cp39-cp39-win_amd64.whl
8658bc81f88e85bbde0cec19c03af250706e440925b901d5bcc8655df212e094
7283 bytes
- tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.0-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.0-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.1-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
da9d26cf106ee7782274e62738bfb7131dfd0b773f2d04c29330cbbce510fb9d
6039 bytes
- tokenizers
0.11.0
tokenizers-0.11.0-cp37-cp37m-win32.whltokenizers-0.11.0-cp37-cp37m-win_amd64.whltokenizers-0.11.0-cp38-cp38-win32.whltokenizers-0.11.0-cp38-cp38-win_amd64.whltokenizers-0.11.0-cp39-cp39-win32.whltokenizers-0.11.0-cp39-cp39-win_amd64.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp37-cp37m-win32.whltokenizers-0.11.1-cp37-cp37m-win_amd64.whltokenizers-0.11.1-cp38-cp38-win32.whltokenizers-0.11.1-cp38-cp38-win_amd64.whltokenizers-0.11.1-cp39-cp39-win32.whltokenizers-0.11.1-cp39-cp39-win_amd64.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp37-cp37m-win32.whltokenizers-0.11.2-cp37-cp37m-win_amd64.whltokenizers-0.11.2-cp38-cp38-win32.whltokenizers-0.11.2-cp38-cp38-win_amd64.whltokenizers-0.11.2-cp39-cp39-win32.whltokenizers-0.11.2-cp39-cp39-win_amd64.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-win32.whltokenizers-0.11.3-cp310-cp310-win_amd64.whltokenizers-0.11.3-cp37-cp37m-win32.whltokenizers-0.11.3-cp37-cp37m-win_amd64.whltokenizers-0.11.3-cp38-cp38-win32.whltokenizers-0.11.3-cp38-cp38-win_amd64.whltokenizers-0.11.3-cp39-cp39-win32.whltokenizers-0.11.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-win32.whltokenizers-0.11.4-cp310-cp310-win_amd64.whltokenizers-0.11.4-cp37-cp37m-win32.whltokenizers-0.11.4-cp37-cp37m-win_amd64.whltokenizers-0.11.4-cp38-cp38-win32.whltokenizers-0.11.4-cp38-cp38-win_amd64.whltokenizers-0.11.4-cp39-cp39-win32.whltokenizers-0.11.4-cp39-cp39-win_amd64.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-win32.whltokenizers-0.11.5-cp310-cp310-win_amd64.whltokenizers-0.11.5-cp37-cp37m-win32.whltokenizers-0.11.5-cp37-cp37m-win_amd64.whltokenizers-0.11.5-cp38-cp38-win32.whltokenizers-0.11.5-cp38-cp38-win_amd64.whltokenizers-0.11.5-cp39-cp39-win32.whltokenizers-0.11.5-cp39-cp39-win_amd64.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-win32.whltokenizers-0.11.6-cp310-cp310-win_amd64.whltokenizers-0.11.6-cp37-cp37m-win32.whltokenizers-0.11.6-cp37-cp37m-win_amd64.whltokenizers-0.11.6-cp38-cp38-win32.whltokenizers-0.11.6-cp38-cp38-win_amd64.whltokenizers-0.11.6-cp39-cp39-win32.whltokenizers-0.11.6-cp39-cp39-win_amd64.whl
1aad24f9a727d2cd3fcbe55b78afba3328c670e6a30eee6ac04c77f98d50a5d7
5876 bytes
- tokenizers
0.11.0
tokenizers-0.11.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.6-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp36-cp36m-macosx_12_0_arm64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.6-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.6-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.11.6-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
597e672f2bc9a8ef65ea09ed37a85c98d3a34f64d113b64c88c0e8d37db20284
4615 bytes
- tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-win32.whltokenizers-0.10.1-cp35-cp35m-win_amd64.whltokenizers-0.10.1-cp36-cp36m-win32.whltokenizers-0.10.1-cp36-cp36m-win_amd64.whltokenizers-0.10.1-cp37-cp37m-win32.whltokenizers-0.10.1-cp37-cp37m-win_amd64.whltokenizers-0.10.1-cp38-cp38-win32.whltokenizers-0.10.1-cp38-cp38-win_amd64.whltokenizers-0.10.1-cp39-cp39-win32.whltokenizers-0.10.1-cp39-cp39-win_amd64.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-win32.whltokenizers-0.10.2-cp35-cp35m-win_amd64.whltokenizers-0.10.2-cp36-cp36m-win32.whltokenizers-0.10.2-cp36-cp36m-win_amd64.whltokenizers-0.10.2-cp37-cp37m-win32.whltokenizers-0.10.2-cp37-cp37m-win_amd64.whltokenizers-0.10.2-cp38-cp38-win32.whltokenizers-0.10.2-cp38-cp38-win_amd64.whltokenizers-0.10.2-cp39-cp39-win32.whltokenizers-0.10.2-cp39-cp39-win_amd64.whl - tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-win32.whltokenizers-0.10.3-cp36-cp36m-win_amd64.whltokenizers-0.10.3-cp37-cp37m-win32.whltokenizers-0.10.3-cp37-cp37m-win_amd64.whltokenizers-0.10.3-cp38-cp38-win32.whltokenizers-0.10.3-cp38-cp38-win_amd64.whltokenizers-0.10.3-cp39-cp39-win32.whltokenizers-0.10.3-cp39-cp39-win_amd64.whl
4610e39a4dee9e1cc96b90fa67d6b993cbddd145446f43d9d8d86ee5c0471566
4484 bytes
- tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.1-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.1-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.1-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.1-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.1-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.1-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.1-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.2-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.2-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.2-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.2-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.2-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.2-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.2-cp39-cp39-manylinux2014_s390x.whl - tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl
027858908b3fbc415b1f9aaa00ede968006be32f97330ba61fa8241899972d7d
4814 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-win32.whltokenizers-0.10.0-cp35-cp35m-win_amd64.whltokenizers-0.10.0-cp36-cp36m-win32.whltokenizers-0.10.0-cp36-cp36m-win_amd64.whltokenizers-0.10.0-cp37-cp37m-win32.whltokenizers-0.10.0-cp37-cp37m-win_amd64.whltokenizers-0.10.0-cp38-cp38-win32.whltokenizers-0.10.0-cp38-cp38-win_amd64.whltokenizers-0.10.0-cp39-cp39-win32.whltokenizers-0.10.0-cp39-cp39-win_amd64.whl
2c56dd30a6e0fb78bcce05e75b64c1b1e3258ebc3611d29ab9451d847bcb2c25
4668 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.0-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.0-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.0-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.0-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.0-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.0-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.0-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.0-cp39-cp39-manylinux2014_s390x.whl
3741eb5c94da5fa49a566acfa5b054fdc1b13c251e5c57a4a715816062065a8a
4242 bytes
- tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-win32.whltokenizers-0.10.0rc1-cp35-cp35m-win_amd64.whltokenizers-0.10.0rc1-cp36-cp36m-win32.whltokenizers-0.10.0rc1-cp36-cp36m-win_amd64.whltokenizers-0.10.0rc1-cp37-cp37m-win32.whltokenizers-0.10.0rc1-cp37-cp37m-win_amd64.whltokenizers-0.10.0rc1-cp38-cp38-win32.whltokenizers-0.10.0rc1-cp38-cp38-win_amd64.whltokenizers-0.10.0rc1-cp39-cp39-win32.whltokenizers-0.10.0rc1-cp39-cp39-win_amd64.whl
2ea11ccb6ae3e01b5915b2532dd5eae5d2937dd12d8ee3cbe3417ca36c626488
4113 bytes
- tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp38-cp38-manylinux2014_s390x.whltokenizers-0.10.0rc1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux1_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.10.0rc1-cp39-cp39-manylinux2014_s390x.whl
13209e42bc86aed2409a7d8b183a7fa0b32f220627f22d21cd2e0e6d9e7e8a16
4234 bytes
- tokenizers
0.9.4
tokenizers-0.9.4-cp35-cp35m-win32.whltokenizers-0.9.4-cp35-cp35m-win_amd64.whltokenizers-0.9.4-cp36-cp36m-win32.whltokenizers-0.9.4-cp36-cp36m-win_amd64.whltokenizers-0.9.4-cp37-cp37m-win32.whltokenizers-0.9.4-cp37-cp37m-win_amd64.whltokenizers-0.9.4-cp38-cp38-win32.whltokenizers-0.9.4-cp38-cp38-win_amd64.whltokenizers-0.9.4-cp39-cp39-win32.whltokenizers-0.9.4-cp39-cp39-win_amd64.whl
fa1eed7ac181372a2df9e120f73549dca56f984beb5ed3e8749f351da5821d07
4105 bytes
- tokenizers
0.9.4
tokenizers-0.9.4-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.4-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.4-cp35-cp35m-manylinux2010_x86_64.whltokenizers-0.9.4-cp35-cp35m-manylinux2014_aarch64.whltokenizers-0.9.4-cp35-cp35m-manylinux2014_ppc64le.whltokenizers-0.9.4-cp35-cp35m-manylinux2014_s390x.whltokenizers-0.9.4-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.4-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.4-cp36-cp36m-manylinux2010_x86_64.whltokenizers-0.9.4-cp36-cp36m-manylinux2014_aarch64.whltokenizers-0.9.4-cp36-cp36m-manylinux2014_ppc64le.whltokenizers-0.9.4-cp36-cp36m-manylinux2014_s390x.whltokenizers-0.9.4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.4-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.4-cp37-cp37m-manylinux2010_x86_64.whltokenizers-0.9.4-cp37-cp37m-manylinux2014_aarch64.whltokenizers-0.9.4-cp37-cp37m-manylinux2014_ppc64le.whltokenizers-0.9.4-cp37-cp37m-manylinux2014_s390x.whltokenizers-0.9.4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.4-cp38-cp38-manylinux1_x86_64.whltokenizers-0.9.4-cp38-cp38-manylinux2010_x86_64.whltokenizers-0.9.4-cp38-cp38-manylinux2014_aarch64.whltokenizers-0.9.4-cp38-cp38-manylinux2014_ppc64le.whltokenizers-0.9.4-cp38-cp38-manylinux2014_s390x.whltokenizers-0.9.4-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.9.4-cp39-cp39-manylinux1_x86_64.whltokenizers-0.9.4-cp39-cp39-manylinux2010_x86_64.whltokenizers-0.9.4-cp39-cp39-manylinux2014_aarch64.whltokenizers-0.9.4-cp39-cp39-manylinux2014_ppc64le.whltokenizers-0.9.4-cp39-cp39-manylinux2014_s390x.whl
48026fe7444f5de02a92b2ec7b64bcf75eaae2654f861930d6762a5bd1a7e81f
4216 bytes
- tokenizers
0.9.0
tokenizers-0.9.0-cp35-cp35m-win32.whltokenizers-0.9.0-cp35-cp35m-win_amd64.whltokenizers-0.9.0-cp36-cp36m-win32.whltokenizers-0.9.0-cp36-cp36m-win_amd64.whltokenizers-0.9.0-cp37-cp37m-win32.whltokenizers-0.9.0-cp37-cp37m-win_amd64.whltokenizers-0.9.0-cp38-cp38-win32.whltokenizers-0.9.0-cp38-cp38-win_amd64.whl - tokenizers
0.9.0.dev4
tokenizers-0.9.0.dev4-cp35-cp35m-win32.whltokenizers-0.9.0.dev4-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev4-cp36-cp36m-win32.whltokenizers-0.9.0.dev4-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev4-cp37-cp37m-win32.whltokenizers-0.9.0.dev4-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev4-cp38-cp38-win32.whltokenizers-0.9.0.dev4-cp38-cp38-win_amd64.whl - tokenizers
0.9.0rc1
tokenizers-0.9.0rc1-cp35-cp35m-win32.whltokenizers-0.9.0rc1-cp35-cp35m-win_amd64.whltokenizers-0.9.0rc1-cp36-cp36m-win32.whltokenizers-0.9.0rc1-cp36-cp36m-win_amd64.whltokenizers-0.9.0rc1-cp37-cp37m-win32.whltokenizers-0.9.0rc1-cp37-cp37m-win_amd64.whltokenizers-0.9.0rc1-cp38-cp38-win32.whltokenizers-0.9.0rc1-cp38-cp38-win_amd64.whl - tokenizers
0.9.0rc2
tokenizers-0.9.0rc2-cp35-cp35m-win32.whltokenizers-0.9.0rc2-cp35-cp35m-win_amd64.whltokenizers-0.9.0rc2-cp36-cp36m-win32.whltokenizers-0.9.0rc2-cp36-cp36m-win_amd64.whltokenizers-0.9.0rc2-cp37-cp37m-win32.whltokenizers-0.9.0rc2-cp37-cp37m-win_amd64.whltokenizers-0.9.0rc2-cp38-cp38-win32.whltokenizers-0.9.0rc2-cp38-cp38-win_amd64.whl - tokenizers
0.9.1
tokenizers-0.9.1-cp35-cp35m-win32.whltokenizers-0.9.1-cp35-cp35m-win_amd64.whltokenizers-0.9.1-cp36-cp36m-win32.whltokenizers-0.9.1-cp36-cp36m-win_amd64.whltokenizers-0.9.1-cp37-cp37m-win32.whltokenizers-0.9.1-cp37-cp37m-win_amd64.whltokenizers-0.9.1-cp38-cp38-win32.whltokenizers-0.9.1-cp38-cp38-win_amd64.whl - tokenizers
0.9.2
tokenizers-0.9.2-cp35-cp35m-win32.whltokenizers-0.9.2-cp35-cp35m-win_amd64.whltokenizers-0.9.2-cp36-cp36m-win32.whltokenizers-0.9.2-cp36-cp36m-win_amd64.whltokenizers-0.9.2-cp37-cp37m-win32.whltokenizers-0.9.2-cp37-cp37m-win_amd64.whltokenizers-0.9.2-cp38-cp38-win32.whltokenizers-0.9.2-cp38-cp38-win_amd64.whl - tokenizers
0.9.3
tokenizers-0.9.3-cp35-cp35m-win32.whltokenizers-0.9.3-cp35-cp35m-win_amd64.whltokenizers-0.9.3-cp36-cp36m-win32.whltokenizers-0.9.3-cp36-cp36m-win_amd64.whltokenizers-0.9.3-cp37-cp37m-win32.whltokenizers-0.9.3-cp37-cp37m-win_amd64.whltokenizers-0.9.3-cp38-cp38-win32.whltokenizers-0.9.3-cp38-cp38-win_amd64.whl
128ed7a0ed8b263ca9b9ecb5e390d5de1aaf1ac4dd8d021df9ca78adab2d1ac7
4087 bytes
- tokenizers
0.9.0
tokenizers-0.9.0-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0.dev4
tokenizers-0.9.0.dev4-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev4-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev4-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev4-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev4-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev4-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0rc1
tokenizers-0.9.0rc1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0rc1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0rc1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0rc1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0rc1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0rc1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0rc1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0rc1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.0rc2
tokenizers-0.9.0rc2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0rc2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0rc2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0rc2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0rc2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0rc2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0rc2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0rc2-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.1
tokenizers-0.9.1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.1-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.2
tokenizers-0.9.2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.2-cp38-cp38-manylinux1_x86_64.whl - tokenizers
0.9.3
tokenizers-0.9.3-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.3-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.3-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.3-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.3-cp38-cp38-manylinux1_x86_64.whl
acd39f78bb80f8615fee31ba97060264ea99ed6c1914ab6440db0238334e8d68
4378 bytes
- tokenizers
0.9.0.dev3
tokenizers-0.9.0.dev3-cp35-cp35m-win32.whltokenizers-0.9.0.dev3-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev3-cp36-cp36m-win32.whltokenizers-0.9.0.dev3-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev3-cp37-cp37m-win32.whltokenizers-0.9.0.dev3-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev3-cp38-cp38-win32.whltokenizers-0.9.0.dev3-cp38-cp38-win_amd64.whl
30210e256ba77d55fdd48eb1ed74a445d6c8c9920edb27cd0b1433038aac3138
4250 bytes
- tokenizers
0.9.0.dev3
tokenizers-0.9.0.dev3-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev3-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev3-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev3-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev3-cp38-cp38-manylinux1_x86_64.whl
27e16c99ecbd8c5959a580c35de2d0bbf387c46000acddcd60c938a0d6432eb7
3456 bytes
- tokenizers
0.9.0.dev2
tokenizers-0.9.0.dev2-cp35-cp35m-win32.whltokenizers-0.9.0.dev2-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev2-cp36-cp36m-win32.whltokenizers-0.9.0.dev2-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev2-cp37-cp37m-win32.whltokenizers-0.9.0.dev2-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev2-cp38-cp38-win32.whltokenizers-0.9.0.dev2-cp38-cp38-win_amd64.whl
7fcf22f9068ae496d99613538a6e09783f14c9728de080a2c5571045eb2ce1f8
3350 bytes
- tokenizers
0.9.0.dev2
tokenizers-0.9.0.dev2-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev2-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev2-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev2-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev2-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev2-cp38-cp38-manylinux1_x86_64.whl
d6a6a759da8b5ee9952e37855e2c5f2238e7eefde66211fd2a04fa554c12cfaa
1942 bytes
- tokenizers
0.9.0.dev1
tokenizers-0.9.0.dev1-cp35-cp35m-win32.whltokenizers-0.9.0.dev1-cp35-cp35m-win_amd64.whltokenizers-0.9.0.dev1-cp36-cp36m-win32.whltokenizers-0.9.0.dev1-cp36-cp36m-win_amd64.whltokenizers-0.9.0.dev1-cp37-cp37m-win32.whltokenizers-0.9.0.dev1-cp37-cp37m-win_amd64.whltokenizers-0.9.0.dev1-cp38-cp38-win32.whltokenizers-0.9.0.dev1-cp38-cp38-win_amd64.whl
a6940fe4a7fad393cd9d9d76c757a65d59c44a8e0808e1bf226cb28db67bacfd
1883 bytes
- tokenizers
0.9.0.dev1
tokenizers-0.9.0.dev1-cp35-cp35m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev1-cp35-cp35m-manylinux1_x86_64.whltokenizers-0.9.0.dev1-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev1-cp36-cp36m-manylinux1_x86_64.whltokenizers-0.9.0.dev1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.9.0.dev1-cp37-cp37m-manylinux1_x86_64.whltokenizers-0.9.0.dev1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.9.0.dev1-cp38-cp38-manylinux1_x86_64.whl