Skip to main content

Yet Another python queue backed by redis; but modern and compliant

Project description

https://img.shields.io/pypi/v/yarqueue.svg https://img.shields.io/travis/clbarnes/yarqueue.svg Documentation Status

Yet Another python queue backed by redis; but modern and compliant

Heavily inspired by hotqueue.

Features

  • Compatible with the API of multiprocessing.Queue

  • LIFO, FIFO and Double-Ended variants

    • Each has a non-joinable and a joinable form (compatible with multiprocessing.JoinableQueue)

  • Additional convenience methods:

    • get_many(), put_many(), clear() for all queues

    • n_tasks() and n_in_progress() for joinable queues

  • Can be used as a context manager

    • Deletes the queue on exit

    • For Joinable variants, first waits for all tasks to be done

  • Can use custom serializers, or none at all

    • By default, uses the highest pickle protocol available, using the pickle5 backport if possible.

  • As thread-safe as the underlying Redis client instance

  • Simple queue watchers

    • yarqwatch: command-line progress bars for given queues

    • yarqserve: simple REST API and browser page for given queues

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

yarqueue-0.4.1.tar.gz (17.7 kB view hashes)

Uploaded Source

Built Distribution

yarqueue-0.4.1-py2.py3-none-any.whl (10.0 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page