Language detection using FastText and Spacy
Project description
spacy_fastlang
Install
Assuming you have a working python environment, you can simply install it using
pip install spacy_fastlang
Usage
The library exports a pipeline component called language_detector
that will set two spacy extensions
- doc._.language = ISO code of the detected language or
xx
as a fallback - doc._.language_score = confidence
import spacy_fastlang
nlp = spacy.load("...")
nlp.add_pipe("language_detector")
doc = nlp(en_text)
doc._.language == "..."
doc._.language_score >= ...
Options
Check the tests to see more examples and available options
License
Everythin is under MIT
except the default model which is distributed under Creative Commons Attribution-Share-Alike License 3.0 by facebook here
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
spacy_fastlang-1.0.1.tar.gz
(782.8 kB
view hashes)
Built Distribution
spacy_fastlang-1.0.1-py3-none-any.whl
(780.4 kB
view hashes)
Close
Hashes for spacy_fastlang-1.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | b93b118143f4134bc40b2b194be77b3be187f0a6aaa01e89b78b41038751f609 |
|
MD5 | d9737179966441e64e7ad17ce520be2e |
|
BLAKE2b-256 | 4412f9dff8c8a01e1a2498106ac37531ac173fbf4e8d7015fcdb5d4a4095212f |