Django uWSGI Taskmanager

Django application to manage async tasks via admin interface, using uWSGI spooler.

Features

• Start and stop your tasks via admin
• Schedule tasks
• Plan tasks as cron items
• Check or download the generated reports/logs
• Simply write a standard Django Command class (your app doesn't need to interact with Django uWSGI Taskmanager)

Installation

0. Pip install the app:

   • via pypi:

     pip install django-uwsgi-taskmanager

   • or via github:

     pip install git+https://github.com/openpolis/django-uwsgi-taskmanager.git

1. Add "taskmanager" to your INSTALLED_APPS setting like this:

   INSTALLED_APPS = [
       "django.contrib.admin",
       # ...
       "taskmanager",
   ]
   

2. Run python manage.py migrate to create the taskmanager tables.

3. Run python manage.py collectcommands to create taskmanager commands.

4. Include the taskmanager URLconf in your project urls.py like this (optional):

   from django.contrib import admin
   from django.urls import include, path
   
   urlpatterns = [
       path("admin/", admin.site.urls),
       path("taskmanager/", include("taskmanager.urls")),
   ]
   

5. Set parameters in your settings file as below (optional):

   TASK_MANAGER_N_LINES_IN_REPORT_INLINE = 10
   TASK_MANAGER_N_REPORTS_INLINE = 3
   TASK_MANAGER_SHOW_LOGVIEWER_LINK = True
   TASK_MANAGER_USE_FILTER_COLLAPSE = True
   TASK_MANAGER_SAVE_LOGFILE = False
   

Usage

You just need to install django-uwsgi-taskmanager in your Django Project and run collectcommands as described. Django uWSGI Taskmanager will collect all the commands and make them available for asynchronous scheduling in the admin.

If you need a new asynchronous task, just write a standard custom Django command, and synchronize the app. Then go to the admin page and schedule it.

You can disable some commands from the admin, and let users (with limited permissions) schedule only the available ones.

uWSGI ini file (vassal) has to include the spooler and pythonpath option.

NOTE: remember to manually create the spooler directory with right permissions before start uWSGI

Demo

This a basic Django demo project with a uwsgi.ini file and four directories (media, spooler, static, venv).

demo/
├── demo/
│   ├── __init__.py
│   ├── settings.py
│   ├── urls.py
│   └── wsgi.py
├── manage.py
├── media/
├── spooler/
├── static/
├── uwsgi.ini
└── venv/

This is the content of uwsgi.ini file required to execute the project with Django:

[uwsgi]
chdir = %d
env = DJANGO_SETTINGS_MODULE=demo.settings
http-socket = :8000
master = true
module = demo.wsgi
plugin = python3
pythonpath = %d
spooler = %dspooler
static-map = /static/=%dstatic
virtualenv = %dvenv

Try the demo project

Enter the demo directory, then create and activate the demo virtual environments:

$ cd demo
$ mkdir -p venv
$ python3 -m venv ./venv
$ source ./venv/bin/activate

Install Django uWSGI taskmanager:

(venv) $ pip install django-uwsgi-taskmanager

Install uWSGI (if you use uWSGI of your OS you can skip this step):

(venv) $ pip install uwsgi

Collect all static files:

(venv) $ python manage.py collectstatic

Create all the tables:

(venv) $ python manage.py migrate

Collect all commands:

(venv) $ python manage.py collectcommands

Create a super user to login the admin:

(venv) $ python manage.py createsuperuser

Start the project with uWSGI:

(venv) $ uwsgi --ini uwsgi.ini

Visit http://127.0.0.1:8000/admin/

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

Unreleased

1.0.1 - 2019-07-13

Changed

• Rename collect_commands to collectcommands
• Add missings setps in README.md

Fixed

• Fix version 1.0.0 release date in CHANGELOG.md
• Add missing __init__.py in migrations directory
• Add missing STATIC_ROOT in demo settings
• Add missing media directory and settings
• Fix convert to local datetime function
• Update and complete setup.py

1.0.0 - 2019-07-12

Added

• First release

Authors

• Gabriele Giaccari (@gabbork)
• Gabriele Lucci (@gabrielelucci)
• Guglielmo Celata (@guglielmo)
• Paolo Melchiorre (@pauloxnet)

License

Django uWSGI taskmanager is an application to manage async tasks via admin interface, using uWSGI spooler.

Copyright (C) 2019 Gabriele Giaccari, Gabriele Lucci, Guglielmo Celata, Paolo Melchiorre

This program is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more details.

You should have received a copy of the GNU Affero General Public License along with this program. If not, see https://www.gnu.org/licenses/.