Python binding for nlpO3 Thai language processing library
Project description
Python binding for nlpO3, a Thai natural language processing library in Rust.
- Thai word tokenizer
- use maximal-matching dictionary-based tokenization algorithm and honor Thai Character Cluster boundaries
- 2.5x faster than similar pure Python implementation
- built-in dictionary included (62,000 words, a copy from PyThaiNLP)
- support custom dictionary
pip install nlpo3
Tokenization using default dictionary:
from nlpo3 import segment
segment("สวัสดีครับ") # returns ["สวัสดี", "ครับ"]
Load file path/to/dict.file
to memory and assigned it with name custom_dict
.
Then tokenize a text with custom_dict
dictionary:
from nlpo3 import load_dict, segment
load_dict("path/to/dict.file", "custom_dict")
segment("สวัสดีครับ", "custom_dict")
For more documentation, go https://github.com/PyThaiNLP/nlpo3
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
nlpo3-1.1.3.tar.gz
(9.1 kB
view hashes)
Built Distributions
nlpo3-1.1.3-cp39-cp39-win_amd64.whl
(851.7 kB
view hashes)
nlpo3-1.1.3-cp39-cp39-win32.whl
(803.6 kB
view hashes)
nlpo3-1.1.3-cp38-cp38-win_amd64.whl
(851.6 kB
view hashes)
nlpo3-1.1.3-cp38-cp38-win32.whl
(803.6 kB
view hashes)
nlpo3-1.1.3-cp37-cp37m-win_amd64.whl
(851.6 kB
view hashes)
nlpo3-1.1.3-cp37-cp37m-win32.whl
(803.6 kB
view hashes)
nlpo3-1.1.3-cp36-cp36m-win_amd64.whl
(851.7 kB
view hashes)
nlpo3-1.1.3-cp36-cp36m-win32.whl
(804.1 kB
view hashes)
Close
Hashes for nlpo3-1.1.3-cp39-cp39-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6cc3d60d2800a9c464c8483d32e8f1d777426f3bd0d8c75e19b486cd314f5980 |
|
MD5 | b8fccb78bc2ce22c78f06dd1a2b7af2d |
|
BLAKE2b-256 | c9b9d95967db4f3eff4172fb2bb38a9074cb3a0358d9059c27d7914ce4b3db67 |
Close
Hashes for nlpo3-1.1.3-cp39-cp39-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 77c2bbeeb5bb2785f8d0130bac7517b88c8fa39b674be6c72563bed95c8b27cc |
|
MD5 | 868fe48c58a62eabbbe0ebb10c28fc35 |
|
BLAKE2b-256 | bcce3a5575682adb848a1d5e18e2b1613a414e8c7f2d778dbf94c831095a2279 |
Close
Hashes for nlpo3-1.1.3-cp39-cp39-manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7e0771809aa97f4a4e79e8888c2a2bfe6677b3d1ab3537ac1c421abd63fd97cf |
|
MD5 | 88b6383f482c4a73faa2329276f42e63 |
|
BLAKE2b-256 | 9effc27fc211b9a29fe8f338ce318eee7ad9e540bdd581d55e588e93ccdf07f0 |
Close
Hashes for nlpo3-1.1.3-cp39-cp39-manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 589e6ab31e30b439fe8624ef9fe5b161100ce76142b61bd1a353cce126ccfc31 |
|
MD5 | 6379dab0b8fa8e9f75e550e6b715bec8 |
|
BLAKE2b-256 | 9016f28c2723cfbb735b7910076ba8e37024a3d42900acfef3e51dc9863849aa |
Close
Hashes for nlpo3-1.1.3-cp39-cp39-macosx_10_13_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 41693885e50bb43d296bfa3069e004ead3d24fc517f93e5d4d04bb7e1d96a569 |
|
MD5 | 267c08cab978855c0f2eb3815478211c |
|
BLAKE2b-256 | 54eb93439371b2ee9dbcd153b0f61a39f8f66ea24cb13fe6c68094081490deae |
Close
Hashes for nlpo3-1.1.3-cp38-cp38-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6a5fb272a7d9d6e4de159f3260e5a6ab68c42e589c792e8660fa10e3baa74971 |
|
MD5 | 6f6e9f493dc58ce4d8de59e9daa83c95 |
|
BLAKE2b-256 | 555fceb9bf4031171e26a69b4dddc9a4ebbb7b15ca897bd15ac78ab59cfa2b73 |
Close
Hashes for nlpo3-1.1.3-cp38-cp38-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e2c5363ee0a15444ee4d7fc54ccc609e51820e1a6dc3fc29fc317c9fde6953e8 |
|
MD5 | 1db02e27a4cc400528f7d42119a35e6d |
|
BLAKE2b-256 | 84172b66ce5a48dc5707ccd60a38849887e45c046bdecc04160784a51ab39265 |
Close
Hashes for nlpo3-1.1.3-cp38-cp38-manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5ce221c56d9ca230f12dfcd52c4f821bfcfd6e22eb72172948658557cf1c6a9f |
|
MD5 | 95ea0d76af00ebef7daa86d2f06eedc2 |
|
BLAKE2b-256 | 782b1027fe23ea5cea07ae83b29b1695a2729ec2ccc7ac6c2635cbff9d9773a5 |
Close
Hashes for nlpo3-1.1.3-cp38-cp38-manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | a00b7b0533e1981633ce56fabe3b63e7b390bc3c4c865efcdffd6c583220d1d0 |
|
MD5 | dc3f53ac09c7a0349e8fc20f464a451f |
|
BLAKE2b-256 | 1cc653eb3c708568ce970415d22ce412c3c066bdd2862c3906ea2e0ec826c879 |
Close
Hashes for nlpo3-1.1.3-cp38-cp38-macosx_10_13_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e2d85ff80ae8a7f74f0bff887563647d00c27bed8b02280a5f95ca522e4cd9bb |
|
MD5 | eb5bcf26f6ddf967dbe2ef10e04b79b2 |
|
BLAKE2b-256 | a005375a4bf3480efde2494cff8aa50a25aa922d1c0437c2e365044eec41f01a |
Close
Hashes for nlpo3-1.1.3-cp37-cp37m-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e9a510fe7b81fce3858f2204394a6d19d8e56df9efbbfceafb56122524ac4aa4 |
|
MD5 | 43aae5b69282eb3ac47a7760c53235c2 |
|
BLAKE2b-256 | a9c257b9f52821158f26d1f2b17edca9f7374a4366e9cd0746552705f77ad007 |
Close
Hashes for nlpo3-1.1.3-cp37-cp37m-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 053233dd06496f63283b74e9ff8496012adfa5bd71477329bd0c2cfb8b079ec4 |
|
MD5 | 05834a907cff3ccafaf39c32a06cd9d1 |
|
BLAKE2b-256 | ebc5cf93b8993f34b7bfc1a1500e0138d4daf5ba2d98584f38f91c991eb9452c |
Close
Hashes for nlpo3-1.1.3-cp37-cp37m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b4b14741aeb61b8ddda3e1a6495d2e87619890bcd115775d3e42b65fd6f7088f |
|
MD5 | 386aa147402f2b77030409c9d288314e |
|
BLAKE2b-256 | 0f7672b83a8d82efe2a6ef58274365a3e7351086e3161299de65c3af52547043 |
Close
Hashes for nlpo3-1.1.3-cp37-cp37m-manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 608a9a116b88c0aa3089f50f91294e4206ecbe2f8e5411b7580bda8f304c311a |
|
MD5 | 91c5fea599de0d19e55decd56b798061 |
|
BLAKE2b-256 | d8445a50eb6372bb85d3c11803479378058feb1813b18f2522681c929600961f |
Close
Hashes for nlpo3-1.1.3-cp37-cp37m-manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 80847f6143102a3f182add8008d2829a1d90d46b432f1b422acc7476d11e0c3b |
|
MD5 | 445496949b869b7ca76e91fd859e8244 |
|
BLAKE2b-256 | ce571dd48fa223e61dbf8a2f08df8c70cb5dc5b3ee3fb5cfa3b40fdebc43cce6 |
Close
Hashes for nlpo3-1.1.3-cp37-cp37m-macosx_10_13_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 76deec15043849143804ca440cc7814febf0e8932c005bc9b9098609eba3e1f8 |
|
MD5 | 87207345e6a4c84aab09cb85d971d188 |
|
BLAKE2b-256 | a7c431d30d858080a0f5607539230bc1879095ee838ecba610b3c306c25c663d |
Close
Hashes for nlpo3-1.1.3-cp36-cp36m-win_amd64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | bed9132829cb4eb38f3201eb6068c3fc7fdb963f56f4b4a9c0cc7beae8124fc5 |
|
MD5 | 2e980c36bf70ded7140733244982712b |
|
BLAKE2b-256 | 56a226506dc61a552889f497e5fc4d31bff49a357051136e60e2cdb4fe79d870 |
Close
Hashes for nlpo3-1.1.3-cp36-cp36m-win32.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0f0ded0cfb2b86d44ca064bcfd8a50f0f0147cbdfef3dd66f2ba9c39709d84f1 |
|
MD5 | ef0277bf63eca1ef7ee0a7f65ed4db83 |
|
BLAKE2b-256 | 365923b471bdf8634267ab595a60efd0313928877fd08c57ee7ed0dc34dbe950 |
Close
Hashes for nlpo3-1.1.3-cp36-cp36m-manylinux2014_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 63a2f7850afe918af58168c7ee87a6383040a6240f65eed54d51564ecf463d0b |
|
MD5 | 30d88d41faad0a05c24312101671619d |
|
BLAKE2b-256 | 97796e79fc8811b3aef97f1170c4684a4dd43156529a9ff7cce29cf993959ff4 |
Close
Hashes for nlpo3-1.1.3-cp36-cp36m-manylinux2014_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | f72c3e11bc91e8058fcf4ade2da04ad98d4ea2dea3a2bb3dfe8c81a72d1781b1 |
|
MD5 | 25668fb7d0f9423d6e4f6a6108402e43 |
|
BLAKE2b-256 | e632d39e31fd7190970f6091a3eaec30d7c54e4d8fabe3903ca3c603232ddd03 |
Close
Hashes for nlpo3-1.1.3-cp36-cp36m-manylinux1_i686.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7fc76ed7ddb78af5c7a63e57e27e45ca9045a9164b11728a1b6d86baebb31bc9 |
|
MD5 | c9cbf4a9d07c9493a824004ea8a18872 |
|
BLAKE2b-256 | 35297679d4f663dd913ab2f0818957d8aebddb5059bb13ada0887a933c3a5501 |
Close
Hashes for nlpo3-1.1.3-cp36-cp36m-macosx_10_13_x86_64.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 32ce196361b8657d10c584a161109a0251542b4d3fbb0f8c22e20361a6823c78 |
|
MD5 | c537c248c3bf60ab4e530f4a2a53906d |
|
BLAKE2b-256 | 255d6bd1eed31544e463a820de9edc61b167a131278ac699179d4bdb72e5d668 |