Tools for tokenizer develope and evaluation
Project description
Tokenizer Tools
Tools for tokenizer develope and evaluation
Free software: MIT license
Documentation: https://tokenizer-tools.readthedocs.io.
Features
TODO
Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
History
0.1.0 (2018-09-05)
First release on PyPI.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
tokenizer_tools-0.3.1.tar.gz
(12.1 kB
view hashes)
Built Distribution
Close
Hashes for tokenizer_tools-0.3.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 740dc5bd020bf9ce7f5004e284c9723438df430ec5d7bd3ba4cfa85ad5808d16 |
|
MD5 | 6423bc0a5d34e2156a49d1b45da6fb36 |
|
BLAKE2b-256 | 6b71e7a9c6d999a7ef9350a7f0cc2fac4813b0e6d58c4f0aaee18f87cfc566eb |