tokenizers/decoders/__init__.py
11 distinct file contents recorded under this name ยท 2000 PyPI records
This name has more records than one lookup returns; counts here are a floor, not a total.
Python source file Reference
A .py file contains Python source code in plain text. The Python interpreter reads the file and runs the code directly, without a separate compile step. Developers write scripts, modules, and full programs in this format. A text editor can open and change the file. Python is one of the most used programming languages, thus .py files are common on many systems.
A file extension is only a part of the file name. It does not give a guarantee about the format or the content of a file. But on Windows, the extension selects the program that opens the file.
Hashes for this file
42bd636c0d9fbeac23801058384c9a0e32c1c03c2405fb4fe63377b51bd3d638
387 bytes
- tokenizers
0.20.4
tokenizers-0.20.4-cp39-abi3-win32.whltokenizers-0.20.4-cp39-abi3-win_amd64.whl - tokenizers
0.20.4rc0
tokenizers-0.20.4rc0-cp39-abi3-win32.whltokenizers-0.20.4rc0-cp39-abi3-win_amd64.whl - tokenizers
0.21.0
tokenizers-0.21.0-cp39-abi3-win32.whltokenizers-0.21.0-cp39-abi3-win_amd64.whl - tokenizers
0.21.0rc0
tokenizers-0.21.0rc0-cp39-abi3-win32.whltokenizers-0.21.0rc0-cp39-abi3-win_amd64.whl - tokenizers
0.21.1
tokenizers-0.21.1-cp39-abi3-win32.whltokenizers-0.21.1-cp39-abi3-win_amd64.whl - tokenizers
0.21.1rc0
tokenizers-0.21.1rc0-cp39-abi3-win32.whltokenizers-0.21.1rc0-cp39-abi3-win_amd64.whl - tokenizers
0.21.2
tokenizers-0.21.2-cp39-abi3-win32.whltokenizers-0.21.2-cp39-abi3-win_amd64.whl - tokenizers
0.21.2rc0
tokenizers-0.21.2rc0-cp39-abi3-win32.whltokenizers-0.21.2rc0-cp39-abi3-win_amd64.whl - tokenizers
0.21.4
tokenizers-0.21.4-cp39-abi3-win32.whltokenizers-0.21.4-cp39-abi3-win_amd64.whl - tokenizers
0.22.0
tokenizers-0.22.0-cp39-abi3-win32.whltokenizers-0.22.0-cp39-abi3-win_amd64.whl - tokenizers
0.22.1
tokenizers-0.22.1-cp39-abi3-win32.whltokenizers-0.22.1-cp39-abi3-win_amd64.whl - tokenizers
0.22.1rc0
tokenizers-0.22.1rc0-cp39-abi3-win32.whltokenizers-0.22.1rc0-cp39-abi3-win_amd64.whl - and 5 more releases view all on the content page
85fc0ce821540ef94c1862f8fb1b1a698cfcd4af4fe6b408e592f950758af18e
372 bytes
- tokenizers
0.20.4
tokenizers-0.20.4-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.20.4-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.20.4-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.20.4rc0
tokenizers-0.20.4rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.20.4rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.4rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.20.4rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.0
tokenizers-0.21.0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.0rc0
tokenizers-0.21.0rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.0rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.0rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.0rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.1
tokenizers-0.21.1-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.1-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.1-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.1rc0
tokenizers-0.21.1rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.1rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.1rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.1rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.2
tokenizers-0.21.2-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.2-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.2-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.2-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.2rc0
tokenizers-0.21.2rc0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.2rc0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.2rc0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.2rc0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.21.4
tokenizers-0.21.4-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.21.4-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.21.4-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.21.4-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.0
tokenizers-0.22.0-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.0-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.0-cp39-abi3-musllinux_1_2_x86_64.whl - tokenizers
0.22.0rc0
tokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.0rc0-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.22.1
tokenizers-0.22.1-cp39-abi3-macosx_10_12_x86_64.whltokenizers-0.22.1-cp39-abi3-macosx_11_0_arm64.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_aarch64.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_armv7l.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_i686.whltokenizers-0.22.1-cp39-abi3-musllinux_1_2_x86_64.whl - and 6 more releases view all on the content page
c5f7eb42df58c6db8a2ce0449099d964fbb4de8cdfdec9bec752a0c45f9fd034
349 bytes
- tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-win32.whltokenizers-0.13.3-cp310-cp310-win_amd64.whltokenizers-0.13.3-cp311-cp311-win32.whltokenizers-0.13.3-cp311-cp311-win_amd64.whltokenizers-0.13.3-cp37-cp37m-win32.whltokenizers-0.13.3-cp37-cp37m-win_amd64.whltokenizers-0.13.3-cp38-cp38-win32.whltokenizers-0.13.3-cp38-cp38-win_amd64.whltokenizers-0.13.3-cp39-cp39-win32.whltokenizers-0.13.3-cp39-cp39-win_amd64.whl - tokenizers
0.14.0
tokenizers-0.14.0-cp310-none-win32.whltokenizers-0.14.0-cp310-none-win_amd64.whltokenizers-0.14.0-cp311-none-win32.whltokenizers-0.14.0-cp311-none-win_amd64.whltokenizers-0.14.0-cp37-none-win32.whltokenizers-0.14.0-cp37-none-win_amd64.whltokenizers-0.14.0-cp38-none-win32.whltokenizers-0.14.0-cp38-none-win_amd64.whltokenizers-0.14.0-cp39-none-win32.whltokenizers-0.14.0-cp39-none-win_amd64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-none-win32.whltokenizers-0.14.1-cp310-none-win_amd64.whltokenizers-0.14.1-cp311-none-win32.whltokenizers-0.14.1-cp311-none-win_amd64.whltokenizers-0.14.1-cp37-none-win32.whltokenizers-0.14.1-cp37-none-win_amd64.whltokenizers-0.14.1-cp38-none-win32.whltokenizers-0.14.1-cp38-none-win_amd64.whltokenizers-0.14.1-cp39-none-win32.whltokenizers-0.14.1-cp39-none-win_amd64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-none-win32.whltokenizers-0.15.0-cp310-none-win_amd64.whltokenizers-0.15.0-cp311-none-win32.whltokenizers-0.15.0-cp311-none-win_amd64.whltokenizers-0.15.0-cp37-none-win32.whltokenizers-0.15.0-cp37-none-win_amd64.whltokenizers-0.15.0-cp38-none-win32.whltokenizers-0.15.0-cp38-none-win_amd64.whltokenizers-0.15.0-cp39-none-win32.whltokenizers-0.15.0-cp39-none-win_amd64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-none-win32.whltokenizers-0.15.1-cp310-none-win_amd64.whltokenizers-0.15.1-cp311-none-win32.whltokenizers-0.15.1-cp311-none-win_amd64.whltokenizers-0.15.1-cp312-none-win32.whltokenizers-0.15.1-cp312-none-win_amd64.whltokenizers-0.15.1-cp37-none-win32.whltokenizers-0.15.1-cp37-none-win_amd64.whltokenizers-0.15.1-cp38-none-win32.whltokenizers-0.15.1-cp38-none-win_amd64.whltokenizers-0.15.1-cp39-none-win32.whltokenizers-0.15.1-cp39-none-win_amd64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-none-win32.whltokenizers-0.15.2-cp310-none-win_amd64.whltokenizers-0.15.2-cp311-none-win32.whltokenizers-0.15.2-cp311-none-win_amd64.whltokenizers-0.15.2-cp312-none-win32.whltokenizers-0.15.2-cp312-none-win_amd64.whltokenizers-0.15.2-cp37-none-win32.whltokenizers-0.15.2-cp37-none-win_amd64.whltokenizers-0.15.2-cp38-none-win32.whltokenizers-0.15.2-cp38-none-win_amd64.whltokenizers-0.15.2-cp39-none-win32.whltokenizers-0.15.2-cp39-none-win_amd64.whl - tokenizers
0.19.0
tokenizers-0.19.0-cp310-none-win32.whltokenizers-0.19.0-cp310-none-win_amd64.whltokenizers-0.19.0-cp311-none-win32.whltokenizers-0.19.0-cp311-none-win_amd64.whltokenizers-0.19.0-cp312-none-win32.whltokenizers-0.19.0-cp312-none-win_amd64.whltokenizers-0.19.0-cp37-none-win32.whltokenizers-0.19.0-cp37-none-win_amd64.whltokenizers-0.19.0-cp38-none-win32.whltokenizers-0.19.0-cp38-none-win_amd64.whltokenizers-0.19.0-cp39-none-win32.whltokenizers-0.19.0-cp39-none-win_amd64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-none-win32.whltokenizers-0.19.1-cp310-none-win_amd64.whltokenizers-0.19.1-cp311-none-win32.whltokenizers-0.19.1-cp311-none-win_amd64.whltokenizers-0.19.1-cp312-none-win32.whltokenizers-0.19.1-cp312-none-win_amd64.whltokenizers-0.19.1-cp37-none-win32.whltokenizers-0.19.1-cp37-none-win_amd64.whltokenizers-0.19.1-cp38-none-win32.whltokenizers-0.19.1-cp38-none-win_amd64.whltokenizers-0.19.1-cp39-none-win32.whltokenizers-0.19.1-cp39-none-win_amd64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-none-win32.whltokenizers-0.20.0-cp310-none-win_amd64.whltokenizers-0.20.0-cp311-none-win32.whltokenizers-0.20.0-cp311-none-win_amd64.whltokenizers-0.20.0-cp312-none-win32.whltokenizers-0.20.0-cp312-none-win_amd64.whltokenizers-0.20.0-cp37-none-win32.whltokenizers-0.20.0-cp37-none-win_amd64.whltokenizers-0.20.0-cp38-none-win32.whltokenizers-0.20.0-cp38-none-win_amd64.whltokenizers-0.20.0-cp39-none-win32.whltokenizers-0.20.0-cp39-none-win_amd64.whl - tokenizers
0.20.1
tokenizers-0.20.1-cp310-none-win32.whltokenizers-0.20.1-cp310-none-win_amd64.whltokenizers-0.20.1-cp311-none-win32.whltokenizers-0.20.1-cp311-none-win_amd64.whltokenizers-0.20.1-cp312-none-win32.whltokenizers-0.20.1-cp312-none-win_amd64.whltokenizers-0.20.1-cp37-none-win32.whltokenizers-0.20.1-cp37-none-win_amd64.whltokenizers-0.20.1-cp38-none-win32.whltokenizers-0.20.1-cp38-none-win_amd64.whltokenizers-0.20.1-cp39-none-win32.whltokenizers-0.20.1-cp39-none-win_amd64.whl - tokenizers
0.20.2
tokenizers-0.20.2-cp310-none-win32.whltokenizers-0.20.2-cp310-none-win_amd64.whltokenizers-0.20.2-cp311-none-win32.whltokenizers-0.20.2-cp311-none-win_amd64.whltokenizers-0.20.2-cp312-none-win32.whltokenizers-0.20.2-cp312-none-win_amd64.whltokenizers-0.20.2-cp313-none-win32.whltokenizers-0.20.2-cp313-none-win_amd64.whltokenizers-0.20.2-cp37-none-win32.whltokenizers-0.20.2-cp37-none-win_amd64.whltokenizers-0.20.2-cp38-none-win32.whltokenizers-0.20.2-cp38-none-win_amd64.whltokenizers-0.20.2-cp39-none-win32.whltokenizers-0.20.2-cp39-none-win_amd64.whl - tokenizers
0.20.3
tokenizers-0.20.3-cp310-none-win32.whltokenizers-0.20.3-cp310-none-win_amd64.whltokenizers-0.20.3-cp311-none-win32.whltokenizers-0.20.3-cp311-none-win_amd64.whltokenizers-0.20.3-cp312-none-win32.whltokenizers-0.20.3-cp312-none-win_amd64.whltokenizers-0.20.3-cp313-none-win32.whltokenizers-0.20.3-cp313-none-win_amd64.whltokenizers-0.20.3-cp37-none-win32.whltokenizers-0.20.3-cp37-none-win_amd64.whltokenizers-0.20.3-cp38-none-win32.whltokenizers-0.20.3-cp38-none-win_amd64.whltokenizers-0.20.3-cp39-none-win32.whltokenizers-0.20.3-cp39-none-win_amd64.whl
946a77da1f2a7ab134178f20c992fcc0699e4159668d5a5e22c45bd5233d91fe
335 bytes
- tokenizers
0.13.3
tokenizers-0.13.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.3-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.3-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.3-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.3-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl - tokenizers
0.14.0
tokenizers-0.14.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.14.1
tokenizers-0.14.1-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.14.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.14.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.14.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.14.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.14.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.14.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.14.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.14.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.14.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.0
tokenizers-0.15.0-cp310-cp310-macosx_10_7_x86_64.whltokenizers-0.15.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_10_7_x86_64.whltokenizers-0.15.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whltokenizers-0.15.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_10_7_x86_64.whltokenizers-0.15.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_10_7_x86_64.whltokenizers-0.15.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_10_7_x86_64.whltokenizers-0.15.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_10_7_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.1
tokenizers-0.15.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.1-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.15.2
tokenizers-0.15.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.15.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.15.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.15.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.15.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.15.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.15.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.15.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.15.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.15.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.15.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.19.0
tokenizers-0.19.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.19.1
tokenizers-0.19.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.19.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.19.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.19.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.19.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.19.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.19.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.19.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_12_i686.manylinux2010_i686.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.19.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.0
tokenizers-0.20.0-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.0-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.0-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.0-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.0-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.0-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.0-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.0-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.0-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.1
tokenizers-0.20.1-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.1-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.1-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.1-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.1-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.1-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.1-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.1-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.1-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.1-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.2
tokenizers-0.20.2-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.2-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.2-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.2-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.20.2-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.2-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.2-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.2-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.2-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.2-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.2-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.2-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl - tokenizers
0.20.3
tokenizers-0.20.3-cp310-cp310-macosx_10_12_x86_64.whltokenizers-0.20.3-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp310-cp310-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp310-cp310-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp311-cp311-macosx_10_12_x86_64.whltokenizers-0.20.3-cp311-cp311-macosx_11_0_arm64.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp311-cp311-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp311-cp311-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp312-cp312-macosx_10_12_x86_64.whltokenizers-0.20.3-cp312-cp312-macosx_11_0_arm64.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp312-cp312-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp312-cp312-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp313-cp313-macosx_10_12_x86_64.whltokenizers-0.20.3-cp313-cp313-macosx_11_0_arm64.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp313-cp313-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp313-cp313-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp313-cp313-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp37-cp37m-macosx_10_12_x86_64.whltokenizers-0.20.3-cp37-cp37m-macosx_11_0_arm64.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp37-cp37m-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp37-cp37m-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp38-cp38-macosx_10_12_x86_64.whltokenizers-0.20.3-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp38-cp38-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp38-cp38-musllinux_1_1_x86_64.whltokenizers-0.20.3-cp39-cp39-macosx_10_12_x86_64.whltokenizers-0.20.3-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_armv7l.manylinux2014_armv7l.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.20.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-cp39-cp39-musllinux_1_1_aarch64.whltokenizers-0.20.3-cp39-cp39-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp310-pypy310_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp37-pypy37_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp38-pypy38_pp73-musllinux_1_1_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-macosx_10_12_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-macosx_11_0_arm64.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_i686.manylinux2014_i686.whltokenizers-0.20.3-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_aarch64.whltokenizers-0.20.3-pp39-pypy39_pp73-musllinux_1_1_x86_64.whl
f5bf78d9a8825fe10a0b764b98e982240a7ab899c546cae67c5a2b5d6b92024d
237 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-win32.whltokenizers-0.13.2-cp310-cp310-win_amd64.whltokenizers-0.13.2-cp311-cp311-win32.whltokenizers-0.13.2-cp311-cp311-win_amd64.whltokenizers-0.13.2-cp37-cp37m-win32.whltokenizers-0.13.2-cp37-cp37m-win_amd64.whltokenizers-0.13.2-cp38-cp38-win32.whltokenizers-0.13.2-cp38-cp38-win_amd64.whltokenizers-0.13.2-cp39-cp39-win32.whltokenizers-0.13.2-cp39-cp39-win_amd64.whl
3a317be7b7765cfd04518754abaf4ade7540b454e787f2be0ea53d269be142c3
227 bytes
- tokenizers
0.13.2
tokenizers-0.13.2-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.2-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp311-cp311-macosx_10_11_universal2.whltokenizers-0.13.2-cp311-cp311-macosx_12_0_arm64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.2-cp38-cp38-macosx_12_0_arm64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.2-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
3212b438e5eff51e2676914ede5e723c271d08d685b66c4e0795d9652861efd2
235 bytes
- tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-win32.whltokenizers-0.13.0-cp310-cp310-win_amd64.whltokenizers-0.13.0-cp37-cp37m-win32.whltokenizers-0.13.0-cp37-cp37m-win_amd64.whltokenizers-0.13.0-cp38-cp38-win32.whltokenizers-0.13.0-cp38-cp38-win_amd64.whltokenizers-0.13.0-cp39-cp39-win32.whltokenizers-0.13.0-cp39-cp39-win_amd64.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-win32.whltokenizers-0.13.1-cp310-cp310-win_amd64.whltokenizers-0.13.1-cp37-cp37m-win32.whltokenizers-0.13.1-cp37-cp37m-win_amd64.whltokenizers-0.13.1-cp38-cp38-win32.whltokenizers-0.13.1-cp38-cp38-win_amd64.whltokenizers-0.13.1-cp39-cp39-win32.whltokenizers-0.13.1-cp39-cp39-win_amd64.whl
56533e997ca56b0ff783b881d76fb399d6fac770da6e9205db32c1adbc388a3d
226 bytes
- tokenizers
0.13.0
tokenizers-0.13.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.0-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.0-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.13.1
tokenizers-0.13.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.13.1-cp310-cp310-macosx_12_0_arm64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.13.1-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.13.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
409f647beaee656541396469b51bffc9603ce8b0bc8cff5134df1a747f052399
205 bytes
- tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-win32.whltokenizers-0.10.3-cp36-cp36m-win_amd64.whltokenizers-0.10.3-cp37-cp37m-win32.whltokenizers-0.10.3-cp37-cp37m-win_amd64.whltokenizers-0.10.3-cp38-cp38-win32.whltokenizers-0.10.3-cp38-cp38-win_amd64.whltokenizers-0.10.3-cp39-cp39-win32.whltokenizers-0.10.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.0
tokenizers-0.11.0-cp37-cp37m-win32.whltokenizers-0.11.0-cp37-cp37m-win_amd64.whltokenizers-0.11.0-cp38-cp38-win32.whltokenizers-0.11.0-cp38-cp38-win_amd64.whltokenizers-0.11.0-cp39-cp39-win32.whltokenizers-0.11.0-cp39-cp39-win_amd64.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp37-cp37m-win32.whltokenizers-0.11.1-cp37-cp37m-win_amd64.whltokenizers-0.11.1-cp38-cp38-win32.whltokenizers-0.11.1-cp38-cp38-win_amd64.whltokenizers-0.11.1-cp39-cp39-win32.whltokenizers-0.11.1-cp39-cp39-win_amd64.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp37-cp37m-win32.whltokenizers-0.11.2-cp37-cp37m-win_amd64.whltokenizers-0.11.2-cp38-cp38-win32.whltokenizers-0.11.2-cp38-cp38-win_amd64.whltokenizers-0.11.2-cp39-cp39-win32.whltokenizers-0.11.2-cp39-cp39-win_amd64.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-win32.whltokenizers-0.11.3-cp310-cp310-win_amd64.whltokenizers-0.11.3-cp37-cp37m-win32.whltokenizers-0.11.3-cp37-cp37m-win_amd64.whltokenizers-0.11.3-cp38-cp38-win32.whltokenizers-0.11.3-cp38-cp38-win_amd64.whltokenizers-0.11.3-cp39-cp39-win32.whltokenizers-0.11.3-cp39-cp39-win_amd64.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-win32.whltokenizers-0.11.4-cp310-cp310-win_amd64.whltokenizers-0.11.4-cp37-cp37m-win32.whltokenizers-0.11.4-cp37-cp37m-win_amd64.whltokenizers-0.11.4-cp38-cp38-win32.whltokenizers-0.11.4-cp38-cp38-win_amd64.whltokenizers-0.11.4-cp39-cp39-win32.whltokenizers-0.11.4-cp39-cp39-win_amd64.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-win32.whltokenizers-0.11.5-cp310-cp310-win_amd64.whltokenizers-0.11.5-cp37-cp37m-win32.whltokenizers-0.11.5-cp37-cp37m-win_amd64.whltokenizers-0.11.5-cp38-cp38-win32.whltokenizers-0.11.5-cp38-cp38-win_amd64.whltokenizers-0.11.5-cp39-cp39-win32.whltokenizers-0.11.5-cp39-cp39-win_amd64.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-win32.whltokenizers-0.11.6-cp310-cp310-win_amd64.whltokenizers-0.11.6-cp37-cp37m-win32.whltokenizers-0.11.6-cp37-cp37m-win_amd64.whltokenizers-0.11.6-cp38-cp38-win32.whltokenizers-0.11.6-cp38-cp38-win_amd64.whltokenizers-0.11.6-cp39-cp39-win32.whltokenizers-0.11.6-cp39-cp39-win_amd64.whl - tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-win32.whltokenizers-0.12.0-cp310-cp310-win_amd64.whltokenizers-0.12.0-cp37-cp37m-win32.whltokenizers-0.12.0-cp37-cp37m-win_amd64.whltokenizers-0.12.0-cp38-cp38-win32.whltokenizers-0.12.0-cp38-cp38-win_amd64.whltokenizers-0.12.0-cp39-cp39-win32.whltokenizers-0.12.0-cp39-cp39-win_amd64.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-win32.whltokenizers-0.12.1-cp310-cp310-win_amd64.whltokenizers-0.12.1-cp37-cp37m-win32.whltokenizers-0.12.1-cp37-cp37m-win_amd64.whltokenizers-0.12.1-cp38-cp38-win32.whltokenizers-0.12.1-cp38-cp38-win_amd64.whltokenizers-0.12.1-cp39-cp39-win32.whltokenizers-0.12.1-cp39-cp39-win_amd64.whl
99b12c16157720c92cd83ed93940db3d3ba734c6c875a14a583de30365b10b83
197 bytes
- tokenizers
0.10.3
tokenizers-0.10.3-cp36-cp36m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.10.3-cp37-cp37m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.10.3-cp38-cp38-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.10.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.10.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl - tokenizers
0.11.0
tokenizers-0.11.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.1
tokenizers-0.11.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.2
tokenizers-0.11.2-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.2-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.2-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.3
tokenizers-0.11.3-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.3-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.3-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.4
tokenizers-0.11.4-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.4-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.4-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.5
tokenizers-0.11.5-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.5-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.5-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.11.6
tokenizers-0.11.6-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.11.6-cp310-cp310-macosx_11_0_arm64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp36-cp36m-macosx_12_0_arm64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.11.6-cp38-cp38-macosx_11_0_arm64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.11.6-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.11.6-cp39-cp39-macosx_11_0_arm64.whltokenizers-0.11.6-cp39-cp39-macosx_12_0_arm64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.11.6-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.12.0
tokenizers-0.12.0-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.0-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.0-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl - tokenizers
0.12.1
tokenizers-0.12.1-cp310-cp310-macosx_10_11_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp310-cp310-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp36-cp36m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp37-cp37m-macosx_10_11_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp37-cp37m-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp38-cp38-macosx_10_11_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp38-cp38-manylinux_2_17_s390x.manylinux2014_s390x.whltokenizers-0.12.1-cp39-cp39-macosx_10_11_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whltokenizers-0.12.1-cp39-cp39-manylinux_2_17_s390x.manylinux2014_s390x.whl
441069d4738e0ac87c14d609dbf687870c7797442d8952208ba7366066613be8
185 bytes
- tokenizers
0.10.0
tokenizers-0.10.0-cp35-cp35m-win32.whltokenizers-0.10.0-cp35-cp35m-win_amd64.whltokenizers-0.10.0-cp36-cp36m-win32.whltokenizers-0.10.0-cp36-cp36m-win_amd64.whltokenizers-0.10.0-cp37-cp37m-win32.whltokenizers-0.10.0-cp37-cp37m-win_amd64.whltokenizers-0.10.0-cp38-cp38-win32.whltokenizers-0.10.0-cp38-cp38-win_amd64.whltokenizers-0.10.0-cp39-cp39-win32.whltokenizers-0.10.0-cp39-cp39-win_amd64.whl - tokenizers
0.10.0rc1
tokenizers-0.10.0rc1-cp35-cp35m-win32.whltokenizers-0.10.0rc1-cp35-cp35m-win_amd64.whltokenizers-0.10.0rc1-cp36-cp36m-win32.whltokenizers-0.10.0rc1-cp36-cp36m-win_amd64.whltokenizers-0.10.0rc1-cp37-cp37m-win32.whltokenizers-0.10.0rc1-cp37-cp37m-win_amd64.whltokenizers-0.10.0rc1-cp38-cp38-win32.whltokenizers-0.10.0rc1-cp38-cp38-win_amd64.whltokenizers-0.10.0rc1-cp39-cp39-win32.whltokenizers-0.10.0rc1-cp39-cp39-win_amd64.whl - tokenizers
0.10.1
tokenizers-0.10.1-cp35-cp35m-win32.whltokenizers-0.10.1-cp35-cp35m-win_amd64.whltokenizers-0.10.1-cp36-cp36m-win32.whltokenizers-0.10.1-cp36-cp36m-win_amd64.whltokenizers-0.10.1-cp37-cp37m-win32.whltokenizers-0.10.1-cp37-cp37m-win_amd64.whltokenizers-0.10.1-cp38-cp38-win32.whltokenizers-0.10.1-cp38-cp38-win_amd64.whltokenizers-0.10.1-cp39-cp39-win32.whltokenizers-0.10.1-cp39-cp39-win_amd64.whl - tokenizers
0.10.2
tokenizers-0.10.2-cp35-cp35m-win32.whltokenizers-0.10.2-cp35-cp35m-win_amd64.whltokenizers-0.10.2-cp36-cp36m-win32.whltokenizers-0.10.2-cp36-cp36m-win_amd64.whltokenizers-0.10.2-cp37-cp37m-win32.whltokenizers-0.10.2-cp37-cp37m-win_amd64.whltokenizers-0.10.2-cp38-cp38-win32.whltokenizers-0.10.2-cp38-cp38-win_amd64.whltokenizers-0.10.2-cp39-cp39-win32.whltokenizers-0.10.2-cp39-cp39-win_amd64.whl - tokenizers
0.8.0
tokenizers-0.8.0-cp35-cp35m-win32.whltokenizers-0.8.0-cp35-cp35m-win_amd64.whltokenizers-0.8.0-cp36-cp36m-win32.whltokenizers-0.8.0-cp36-cp36m-win_amd64.whltokenizers-0.8.0-cp37-cp37m-win32.whltokenizers-0.8.0-cp37-cp37m-win_amd64.whltokenizers-0.8.0-cp38-cp38-win32.whltokenizers-0.8.0-cp38-cp38-win_amd64.whl - tokenizers
0.8.0rc1
tokenizers-0.8.0rc1-cp36-cp36m-win32.whltokenizers-0.8.0rc1-cp37-cp37m-win32.whltokenizers-0.8.0rc1-cp38-cp38-win32.whl - tokenizers
0.8.0rc2
tokenizers-0.8.0rc2-cp35-cp35m-win_amd64.whltokenizers-0.8.0rc2-cp36-cp36m-win_amd64.whltokenizers-0.8.0rc2-cp37-cp37m-win_amd64.whltokenizers-0.8.0rc2-cp38-cp38-win_amd64.whl - tokenizers
0.8.0rc3
tokenizers-0.8.0rc3-cp35-cp35m-win32.whltokenizers-0.8.0rc3-cp36-cp36m-win32.whltokenizers-0.8.0rc3-cp37-cp37m-win32.whltokenizers-0.8.0rc3-cp37-cp37m-win_amd64.whltokenizers-0.8.0rc3-cp38-cp38-win32.whltokenizers-0.8.0rc3-cp38-cp38-win_amd64.whl - tokenizers
0.8.0rc4
tokenizers-0.8.0rc4-cp35-cp35m-win32.whltokenizers-0.8.0rc4-cp35-cp35m-win_amd64.whltokenizers-0.8.0rc4-cp36-cp36m-win32.whltokenizers-0.8.0rc4-cp36-cp36m-win_amd64.whltokenizers-0.8.0rc4-cp37-cp37m-win32.whltokenizers-0.8.0rc4-cp37-cp37m-win_amd64.whltokenizers-0.8.0rc4-cp38-cp38-win32.whltokenizers-0.8.0rc4-cp38-cp38-win_amd64.whl - tokenizers
0.8.1
tokenizers-0.8.1-cp35-cp35m-win32.whltokenizers-0.8.1-cp35-cp35m-win_amd64.whltokenizers-0.8.1-cp36-cp36m-win32.whltokenizers-0.8.1-cp36-cp36m-win_amd64.whltokenizers-0.8.1-cp37-cp37m-win32.whltokenizers-0.8.1-cp37-cp37m-win_amd64.whltokenizers-0.8.1-cp38-cp38-win32.whltokenizers-0.8.1-cp38-cp38-win_amd64.whl - tokenizers
0.8.1rc1
tokenizers-0.8.1rc1-cp35-cp35m-win32.whltokenizers-0.8.1rc1-cp35-cp35m-win_amd64.whltokenizers-0.8.1rc1-cp36-cp36m-win32.whltokenizers-0.8.1rc1-cp36-cp36m-win_amd64.whltokenizers-0.8.1rc1-cp37-cp37m-win32.whltokenizers-0.8.1rc1-cp37-cp37m-win_amd64.whltokenizers-0.8.1rc1-cp38-cp38-win32.whltokenizers-0.8.1rc1-cp38-cp38-win_amd64.whl - tokenizers
0.8.1rc2
tokenizers-0.8.1rc2-cp35-cp35m-win32.whltokenizers-0.8.1rc2-cp35-cp35m-win_amd64.whltokenizers-0.8.1rc2-cp36-cp36m-win32.whltokenizers-0.8.1rc2-cp36-cp36m-win_amd64.whltokenizers-0.8.1rc2-cp37-cp37m-win32.whltokenizers-0.8.1rc2-cp37-cp37m-win_amd64.whltokenizers-0.8.1rc2-cp38-cp38-win32.whltokenizers-0.8.1rc2-cp38-cp38-win_amd64.whl - and 12 more releases view all on the content page