tokenizers-0.20.3/bindings/python/tests/bindings/test_normalizers.py
1 distinct file content recorded under this name ยท 1 PyPI record
Python source file Reference
A .py file contains Python source code in plain text. The Python interpreter reads the file and runs the code directly, without a separate compile step. Developers write scripts, modules, and full programs in this format. A text editor can open and change the file. Python is one of the most used programming languages, thus .py files are common on many systems.
A file extension is only a part of the file name. It does not give a guarantee about the format or the content of a file. But on Windows, the extension selects the program that opens the file.
Hashes for this file
18e2d28d3853211c4999702fec14cb21ed48695c5b87c92d5b9f80d845e4b059
6365 bytes
- tokenizers
0.20.3
tokenizers-0.20.3.tar.gz