SimpleDER

Overview

This is a lightweight library to compute Diarization Error Rate (DER).

Features NOT supported:

• Handling overlapped speech, i.e. two speakers speaking at the same time.
• Allowing segment boundary tolerance, a.k.a. the collar value.

For more sophisticated with these supports, please use pyannote-metrics instead.

To learn more about speaker diarization, here is a curated list of resources: awesome-diarization.

Tutorial

Here is a minimal example:

import der

# reference (ground truth)
ref = [("A", 0.0, 1.0),
       ("B", 1.0, 1.5),
       ("A", 1.6, 2.1)]

# hypothesis (diarization result from your algorithm)
hyp = [("1", 0.0, 0.8),
       ("2", 0.8, 1.4),
       ("3", 1.5, 1.8),
       ("1", 1.8, 2.0)]

error = der.DER(ref, hyp)

print("DER={:.3f}".format(error))

This should output:

DER=0.350