Skip to main content

Toolkit that simplifies corpus processing

Project description

RuMor: Russian Morphology project

Corpuscula: a python NLP library for corpus processing

PyPI Version Python Version License: BSD-3

A part of RuMor project. It contains tools to simplify corpus processing. Highlights are:

  • full CoNLL-U support (includes CoNLL-U Plus)
  • wrappers for known corpora of Russian language
  • parser and wrapper for Russian part of Wikipedia
  • Corpus Dictionary that can be used for further morphology processing
  • simple database to keep named entities

Installation

pip

Corpuscula supports Python 3.5 or later. To install it via pip, run:

$ pip install corpuscula

If you currently have a previous version of Corpuscula installed, use:

$ pip install corpuscula -U

From Source

Alternatively, you can also install Corpuscula from source of this git repository:

$ git clone https://github.com/fostroll/corpuscula.git
$ cd corpuscula
$ pip install -e .

This gives you access to examples and data that are not included to the PyPI package.

Setup

After installation, you need to specify a directory where you prefer to store downloaded corpora:

>>> import corpuscula.corpus_utils as cu
>>> cu.set_root_dir(<path>)  # We will keep corpora here

NB: it will create/update config file .rumor in your home directory.

If you won't set the root directory, Corpuscula will keep corpora in the directory where it's installed.

Usage

CoNLL-U Support

Management of Corpora

Wrapper for Wikipedia

Corpus Dictionary

Utilities

Items database

Examples

You can find examples in the directory examples of our Corpuscula github repository.

License

Corpuscula is released under the BSD License. See the LICENSE file for more details.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

corpuscula-1.0.56.tar.gz (30.2 kB view hashes)

Uploaded Source

Built Distribution

corpuscula-1.0.56-py3-none-any.whl (32.1 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page