Workers, Queues, and Tasks

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

Features currently being evaluated

Feature Description
Synopsis Packages' organizational style and method of Django integration
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI Native support for uWSGI builtin spooler

Filter results

Package celery Dramatiq huey Django Q django-rq Trigger Happy django-apscheduler django-celery-results Celery Progress Bars for Django django-background-tasks Django-celery django_dramatiq django-celery-monitor django-task django-lightweight-queue django-uwsgi-taskmanager django-toosimple-q Django Task API modelqueue django-carrot django-uwsgi-spooler djcall django-tasker django-admin-rq autotask django-rq-jobs django-rq-dashboard django-pq django-signalqueue jobtastic django-kitsune django-chronograph
Package celery Dramatiq huey Django Q django-rq Trigger Happy django-apscheduler django-celery-results Celery Progress Bars for Django django-background-tasks Django-celery django_dramatiq django-celery-monitor django-task django-lightweight-queue django-uwsgi-taskmanager django-toosimple-q Django Task API modelqueue django-carrot django-uwsgi-spooler djcall django-tasker django-admin-rq autotask django-rq-jobs django-rq-dashboard django-pq django-signalqueue jobtastic django-kitsune django-chronograph
Description Distributed Task Queue
(development branch)
A fast and reliable background
task processing library for
Python 3.
a little task queue for python A multiprocessing distributed
task queue for Django
A simple app that provides
django integration for RQ
(Redis Queue)
:snake: Trigger Happy - The
bus :bus: for your internet
services
APScheduler for Django Celery result back end with
django
Drop in, configurable,
dependency-free progress bars
for your Django/Celery
applications.
A database-backed work queue
for Django
Old Celery integration project
for Django
A Django app that integrates
with Dramatiq.
Celery Monitoring for Django A Django app to run new
background tasks from either
admin or cron, and inspect
task history from admin
Lightweight & modular queue
and cron system for Django
Django application to monitor
and manage long and/or
recurring tasks through uWSGI.
Simplistic task queue and
cron-like scheduler for Django
A REST API and JavaScript
library for managing
background tasks in Django
projects
Task queue based on Django
models.
A lightweight task queue for
Django using RabbitMQ
HALTED IN FAVOR OF
yourlabs/django-call Task
model to get the most out of
uWSGI's spooler with minimal
effort with CRUDLFA...
MOVED to
yourlabs.io/oss/djcall !!
Spooled and Cron generic task
models, like django-q but for
uWSGI builtin features
Dead simple async task queue.
Stores tasks in database.
Django admin rq is a django
package that creates a 4 step
(form, preview, main,
complete) asynchronous
workflow from ...
Provides scheduled jobs
management from the Django
Admin using Django-RQ
A dashboard for managing RQ in
the Django admin
[UNMAINTAINED] A task queue
based on the elegant python RQ
but with a django postgresql
backend.
Truly asynchronous Django
signals!
Make your user-responsive
long-running Celery jobs
totally awesomer.
Host server monitoring app for
Django Admin. Allows to
schedule checks on hosts and
notify results to
administrators by mail.
Category Other App App App App App App App Other App App App App App App App App App Other App App App App App App App App App App Other App App
# Using This 10 1 9 19 20 5 0 0 0 1 79 0 1 1 0 1 0 0 0 1 0 0 0 1 1 1 2 0 1 1 1 1
Python 3?
Development Status Production/Stable Unknown Beta Production/Stable Beta Production/Stable Beta Production/Stable Unknown Production/Stable Production/Stable Unknown Production/Stable Production/Stable Production/Stable Beta Alpha Unknown Alpha Production/Stable Planning Pre-Alpha Beta Beta Beta Beta Alpha Alpha Beta Beta Unknown Unknown
Last updated Oct. 11, 2021, 1:10 p.m. Sept. 19, 2021, 7:59 a.m. Sept. 16, 2021, 8:42 a.m. June 26, 2021, 8:04 a.m. Sept. 27, 2021, 8:31 p.m. May 1, 2020, 8:07 a.m. July 23, 2021, 2:32 a.m. Oct. 11, 2021, 2:31 p.m. Oct. 11, 2021, 9:13 a.m. Dec. 23, 2019, 9:34 a.m. Feb. 26, 2020, 11:59 a.m. July 16, 2021, 2:45 a.m. Nov. 26, 2020, 12:17 p.m. June 13, 2021, 6:05 p.m. Oct. 4, 2021, 10:50 a.m. May 4, 2021, 3:52 p.m. July 15, 2021, 5:04 p.m. Sept. 10, 2021, 5:58 p.m. April 19, 2018, 7:49 p.m. April 14, 2019, 3:56 p.m. Aug. 2, 2018, 9:35 a.m. Sept. 20, 2018, 11:54 a.m. April 17, 2019, 9:31 a.m. Nov. 2, 2017, 9:15 a.m. Aug. 11, 2016, 9:01 a.m. July 29, 2015, 8:34 a.m. June 13, 2017, 11:10 a.m. Oct. 12, 2014, 10:39 p.m. Jan. 20, 2014, 9:44 p.m. May 8, 2019, 9:48 a.m. Nov. 6, 2014, 9:54 a.m. March 5, 2013, 11:39 p.m.
Version 5.1.2 1.11.0 2.4.1 1.3.9 2.4.1 1.7.0 0.6.0 2.2.0 0.1.1 1.2.5 3.3.1 0.10.0 1.1.2 2.0.1 4.1.0 2.2.12 0.3.1 1.2.5 1.0.3 1.5.0 0.0.0 0.2.0 0.2.60 0.2.0 0.5.4 0.1.5.1 0.3.3 0.3.2 0.5.1 2.1.1 0.2.3 0.3.1
Repo GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub Bitbucket GitHub GitHub GitHub GitHub GitHub GitHub Bitbucket
Commits
Stars 18062 2750 3656 1358 1446 1355 415 396 283 520 1435 213 141 36 21 21 6 6 2 60 n/a 2 1 6 8 30 86 68 54 639 66 62
Repo Forks 4112 198 316 201 241 129 75 144 70 107 455 51 55 6 3 3 n/a 2 1 12 n/a n/a n/a 2 5 6 30 7 4 58 13 35
Participants ask
thedrow
auvipy
mher
ionelmc
piotrmaslanka
nvie
maybe-sybr
mchataigner
graingert
more...
Bogdanp
rpkilby
ryansm1
gdvalle
takhs91
davidt99
bersace
rouge8
najamansari
benekastah
more...
coleifer
jbaiter
antwan
camilonova
blablacio
logannc
adamchainz
gl3nn
hgdeoro
jedie
more...
Koed00
Eagllus
jmcvetta
danielwelch
janneronkko
timomeara
yannpom
benjaoming
kennyhei
telmobarros
more...
selwin
dependabot-preview[bot]
lechup
SeiryuZ
jeanphix
Krukov
acjay
hendi
therefromhere
dependabot[bot]
more...
foxmask
koalie
CrazyLlama
Logan1x
h-chauhan
adrienlachaize
philippeowagner
pouete
Leopere
scomert
more...
jcass77
jarekwg
sallyruthstruik
soon
Jedore
akoltsov-spoton
bnjmnhndrsn
countable
D4VIDB2
daniel-butler
more...
auvipy
ask
thedrow
arnau126
AllexVeldman
pre-commit-ci[bot]
AlecTroemel
jaylynch
etnguyen03
maxmalysh
more...
czue
EJH2
OmarWKH
oisinBates
ashutoshsingh0223
ivn86
mcrot
abedyngash
eeintech
JoeSc
more...
philippeowagner
lilspikey
jvamvas
yannik-ammann
walterrenner
Luthaf
Zagrebelin
johnsensible
december1981
cedricfarinazzo
more...
ask
auvipy
vytisb
ionelmc
diegueus9
thedrow
jezdez
jasonbaker
iamjstates
piotrbulinski
more...
Bogdanp
jcass77
rpkilby
denizdogan
MattBlack85
rakanalh
ramonsaraiva
Sovetnikov
aericson
theotherbjorn
more...
jezdez
pyup-bot
janezkranjc
mhsekhavat
morlandi PeterJCLaw
lamby
danpalmer
prophile
tomokas
lirsacc
mthpower
tavva
cbaines
hythloday
gabrielelucci
guglielmo
pauloxnet
unusual-thoughts
olivierdalang nikmolnar
dependabot[bot]
brendan-ward
grantjenks chris104957
ewsterrenburg
jpic jpic wooyek Proper-Job kbr Koed00
likeon
brutasse
olarin
ihuro
jleclanche
spapas
wastrachan
nsbk
sbussetti
bretth
saulshanabrook
fish2000
bitdeli-chef
winhamwr
jlward
deti
midnightlynx
rhunwicks
caffodian
kylegibson
abbasovalex
georgemarshall
singingwolfboy
more...
raulgarreta
amartinezuy
wnielson
Documentation N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Synopsis Multiprocessing worker pool

Django native

Encrypted and compressed task packages

Scheduled tasks

Result hooks

Result and Failure database

Redis, DIsque, IronMQ , SQS, MongoDB or ORM broker

Django Admin

Multi Cluster Monitor

Worker cpu affinity
A simple app that provides django integration for RQ (http://python-rq.org) Provides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process. Monitor Celery tasks and workers in the admin. Formerly included in django-celery. Purposes:

- create async tasks either programmatically or from admin

- monitor async tasks from admin

- log all tasks in the database for later inspection

- optionally save task-specific logs in a TextField and/or in a FileField


Based on:
- django-rq
# Features

- Start and stop your tasks via admin

- Schedule tasks

- Plan tasks as cron items

- Check or download the generated reports/logs

-Simply write a standard Django Command class (your app doesn't need to interact with Django uWSGI Taskmanager)
ModelQueue is an Apache2 licensed task queue based on Django models. Django models to wrap around uWSGI native spooler and cron features. Scheduled jobs management Django Admin plugin using Django-RQ

Supports once, daily, weekly, monthly, quarterly and yearly scheduled tasks.
Jobs can be limited to a set number of repeats.
Both regular tasks and management commands can be scheduled.
All tasks are queued to RQ , enabling a large payload schedule without delays.
Define and dispatch asynchronous Django signals, using the same semantics as their inbuilt synchronous counterparts. Originally developed for ImageKit -- https://github.com/jdriscoll/django-imagekit -- to decouple image pipeline processing from view functions. Offers a easily implemented engine API, an extensible JSON-based interprocess protocol; off-the-shelf backends leverage the characteristics of several Redis and relational datastructures. A Django Admin app to perform host server monitoring. A control panel will be added to the Admin in order to configure hosts, checks and monitor check results. Notification rules can be defined to notify administrator users by mail. Provides a master hook for the Cron daemon. Periodic tasks can then be defined within the Django admin panel -- no need to mess around with fragile crontab syntax with superuser privileges. Run any Django ./manage.py commands as needed: every minute, every day, or whatever in between.
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI
Search Weight Package Description Last PyPI release: Repo Forks Stars
{{ item.weight / max_weight * 100 | number:0 }}% {{ item.title }} Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A