Skip to main content

PQDM is a TQDM and concurrent futures wrapper to allow enjoyable paralellization of progress bars.

Project description

Parallel TQDM

https://img.shields.io/pypi/v/pqdm.svg Documentation Status Updates

PQDM is a TQDM and concurrent futures wrapper to allow enjoyable paralellization of iterating through an Iterable with a progress bar.

Install & Use

To install

pip install pqdm

and use

from pqdm.processes import pqdm
# If you want threads instead:
# from pqdm.threads import pqdm

args = [1, 2, 3, 4, 5]
# args = range(1,6) would also work

def square(a):
    return a*a

result = pqdm(args, square, n_jobs=2)

For more examples variants check the Usage section of the docs.

Features

  • parellize your tqdm runs using processes or threads thanks to concurrent.futures,

  • just import pqdm from pqdm.threads or pqdm.processes to start,

  • automatic usage of tqdm.notebook when iPython/Jupyter notebook environment detected, custom tqdm class accepted

  • automatic parsing of pqdm kwargs and separating between concurrent.Executor args and tqdm args,

  • support for any iterable and passing items as kwargs, args or directly to function which is being applied

  • support bounded exectutors via https://github.com/mowshon/bounded_pool_executor

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

0.2.0 (2022-02-14)

  • Adds exception handling

  • Allows using custom tqdm_class (like tqdm_discord)

  • Minor fixes

0.1.0 (2020-03-07)

  • Some updates in progress reporting and documentation.

0.0.1 (2020-03-05)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pqdm-0.2.0.tar.gz (13.9 kB view hashes)

Uploaded Source

Built Distribution

pqdm-0.2.0-py2.py3-none-any.whl (6.8 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page