Inter-annotator agreement measure and alignmentwritten in python
Project description
Pygamma-agreement
pygamma-agreement is an open-source package to measure Inter/Intra-annotator agreement for sequences of annotations with the γ measure [^2]. It is written in Python 3 and based mostly on NumPy, Numba and pyannote.core. For a full list of available functions, please refer to the package documentation.
Dependencies
The main dependencies of pygamma-agreement are :
- NumPy (>= 1.10)
- sortedcontainers (>=2.0.4)
- pyannote.core (>= 4.1)
- Matplotlib (>= 2.0)
- CVXPY (== 1.0.25)
- Numba (>= 0.48.0)
- TextGrid (>= 1.5)
pygamma-agreement is a Python 3 package and is currently tested for Python 3.7. pygamma-agreement does not work with Python 2.7.
Installation
pygamma-agreement can be easily installed using pip
pip install pygamma-agreement
Tests
The package comes with a unit-tests suit. To run it, first install pytest on your Python environment:
pip install pytest
pytest test/
References
[1] Titeux H., Riad R. pygamma-agreement: Gamma γ measure for inter/intra-annotator agreement in Python.
[2] Mathet Y., Widlöcher A., Métivier, J.P. The unified and holistic method gamma γ for inter-annotator agreement measure and alignment. Computational Linguistics
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
