Language detection using FastText and Spacy
Project description
spacy_fastlang
Install
Assuming you have a working python environment, you can simply install it using
pip install spacy_fastlang
Usage
The library exports a pipeline component called LanguageDetector
that will set two spacy extensions
- doc._.language = ISO code of the detected language or
xx
as a fallback - doc._.language_score = confidence
from spacy_fastlang import LanguageDetector
nlp = spacy.load("...")
nlp.add_pipe(LanguageDetector())
doc = nlp(en_text)
doc._.language == "..."
doc._.language_score >= ...
Check the tests to see more examples and available options
License
Everythin is under MIT
except the default model which is distributed under Creative Commons Attribution-Share-Alike License 3.0 by facebook here
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
spacy_fastlang-0.4.0.tar.gz
(782.6 kB
view hashes)
Built Distribution
spacy_fastlang-0.4.0-py3-none-any.whl
(780.2 kB
view hashes)
Close
Hashes for spacy_fastlang-0.4.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 020dfba3bf7f7010425a15c6603d93bdcd92ced485c70048c8e4949abc802dc6 |
|
MD5 | 5975245a9b7a205bf97332d498c5045d |
|
BLAKE2b-256 | c21dc0094af741237cf6389fce0eb1165677a9e8434398a370c55c0b4c518145 |