Workers, Queues, and Tasks

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

Features currently being evaluated

Feature Description
Synopsis Packages' organizational style and method of Django integration
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI Native support for uWSGI builtin spooler

Filter results

Package celery Dramatiq huey Django-celery Django Q django-rq django-celery-results django-apscheduler Celery Progress Bars for Django Trigger Happy django_dramatiq django-celery-monitor django-task django-lightweight-queue django-uwsgi-taskmanager django-toosimple-q django-rq-scheduler Django Task API modelqueue django-celery-extensions
Package celery Dramatiq huey Django-celery Django Q django-rq django-celery-results django-apscheduler Celery Progress Bars for Django Trigger Happy django_dramatiq django-celery-monitor django-task django-lightweight-queue django-uwsgi-taskmanager django-toosimple-q django-rq-scheduler Django Task API modelqueue django-celery-extensions
Description Distributed Task Queue
(development branch)
A fast and reliable background
task processing library for
Python 3.
a little task queue for python Old Celery integration project
for Django
A multiprocessing distributed
task queue for Django
A simple app that provides
django integration for RQ
(Redis Queue)
Celery result back end with
django
APScheduler for Django Drop in, configurable,
dependency-free progress bars
for your Django/Celery
applications.
:snake: Trigger Happy - The
bus :bus: for your internet
services
A Django app that integrates
with Dramatiq.
Celery Monitoring for Django A Django app to run new
background tasks from either
admin or cron, and inspect
task history from admin
Lightweight & modular queue
and cron system for Django
Django application to monitor
and manage long and/or
recurring tasks through uWSGI.
Simplistic task queue and
cron-like scheduler for Django
A database backed job
scheduler for Django RQ with
Django
A REST API and JavaScript
library for managing
background tasks in Django
projects
Task queue based on Django
models.
Category Other App App App App App App App Other App App App App App App App App App Other App
# Using This 10 1 9 83 21 22 0 0 0 5 0 1 2 0 1 0 0 0 0 0
Python 3?
Development Status Production/Stable Unknown Beta Production/Stable Production/Stable Beta Production/Stable Beta Unknown Production/Stable Unknown Production/Stable Production/Stable Production/Stable Beta Alpha Production/Stable Unknown Beta Alpha
Last updated June 26, 2022, 5:59 a.m. June 17, 2022, 1:40 a.m. June 13, 2022, 8:52 a.m. June 18, 2022, 9:41 p.m. June 26, 2021, 8:04 a.m. Jan. 23, 2022, 10:07 p.m. June 22, 2022, 4:50 a.m. March 5, 2022, 11:21 p.m. Feb. 11, 2022, 6:42 a.m. May 1, 2020, 8:07 a.m. June 11, 2022, 11:33 a.m. Nov. 10, 2021, 6:41 a.m. April 8, 2022, 4:34 a.m. June 27, 2022, 7:02 a.m. Oct. 6, 2021, 2:28 p.m. March 29, 2022, 5:26 p.m. June 24, 2022, 8:16 a.m. March 7, 2022, 6:37 p.m. March 31, 2022, 5:59 p.m. March 14, 2022, 1:19 p.m.
Version 5.2.7 1.13.0 2.4.3 3.3.1 1.3.9 2.5.1 2.3.1 0.6.2 0.1.2 1.7.0 0.11.0 1.1.2 2.0.5 4.5.1 2.2.14 0.4.0 2022.6.2 1.4.1 2.2.1 0.0.31
Repo GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub
Commits
Stars 19,594 3,139 4,105 1,457 1,532 1,531 469 511 338 1,347 236 157 43 23 22 12 7 8 3 4
Repo Forks 4,312 228 347 462 223 254 170 86 78 129 59 62 6 4 3 0 2 4 2 2
Participants ask
thedrow
auvipy
mher
ionelmc
piotrmaslanka
nvie
maybe-sybr
mchataigner
graingert
more...
Bogdanp
rpkilby
FinnLidbetter
ryansm1
gdvalle
takhs91
davidt99
bersace
rouge8
kurtmckee
more...
coleifer
jbaiter
antwan
camilonova
blablacio
adamchainz
logannc
gl3nn
hgdeoro
jedie
more...
ask
auvipy
vytisb
ionelmc
diegueus9
thedrow
jezdez
jasonbaker
iamjstates
piotrbulinski
more...
Koed00
Eagllus
jmcvetta
danielwelch
janneronkko
timomeara
yannpom
benjaoming
kennyhei
telmobarros
more...
selwin
dependabot-preview[bot]
lechup
SeiryuZ
jeanphix
Krukov
dependabot[bot]
acjay
hendi
therefromhere
more...
auvipy
ask
thedrow
pre-commit-ci[bot]
arnau126
AllexVeldman
ifmos
AlecTroemel
jaylynch
etnguyen03
more...
jcass77
jarekwg
sallyruthstruik
soon
Jedore
akoltsov-spoton
bnjmnhndrsn
countable
D4VID0x2
daniel-butler
more...
czue
EJH2
OmarWKH
oisinBates
ashutoshsingh0223
ivn86
mcrot
mobiware
timnyborg
abedyngash
more...
foxmask
koalie
CrazyLlama
Logan1x
h-chauhan
adrienlachaize
philippeowagner
pouete
Leopere
scomert
more...
Bogdanp
jcass77
rpkilby
denizdogan
MattBlack85
rakanalh
ramonsaraiva
Sovetnikov
aericson
theotherbjorn
more...
jezdez
pyup-bot
janezkranjc
jazzband-bot
mhsekhavat
morlandi PeterJCLaw
lamby
danpalmer
prophile
tomokas
lirsacc
mthpower
tavva
cbaines
itsthejoker
more...
gabrielelucci
guglielmo
pauloxnet
unusual-thoughts
olivierdalang cunla
g3rd
frbry
tom-price
unterwegi
bashhack
dependabot[bot]
oudeismetis
jcarbaugh
josephabrahams
more...
nikmolnar
dependabot[bot]
brendan-ward
JensTimmerman
grantjenks matllubos
radimsuckr
jsilhan
Documentation n/a n/a n/a n/a n/a n/a n/a
Synopsis Provides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process. Multiprocessing worker pool

Django native

Encrypted and compressed task packages

Scheduled tasks

Result hooks

Result and Failure database

Redis, DIsque, IronMQ , SQS, MongoDB or ORM broker

Django Admin

Multi Cluster Monitor

Worker cpu affinity
A simple app that provides django integration for RQ (http://python-rq.org) Monitor Celery tasks and workers in the admin. Formerly included in django-celery. Purposes:

- create async tasks either programmatically or from admin

- monitor async tasks from admin

- log all tasks in the database for later inspection

- optionally save task-specific logs in a TextField and/or in a FileField


Based on:
- django-rq
# Features

- Start and stop your tasks via admin

- Schedule tasks

- Plan tasks as cron items

- Check or download the generated reports/logs

-Simply write a standard Django Command class (your app doesn't need to interact with Django uWSGI Taskmanager)
ModelQueue is an Apache2 licensed task queue based on Django models.
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI
Search Weight Package Description Last PyPI release: Repo Forks Stars
{{ item.weight / max_weight * 100 | number:0 }}% {{ item.title }} Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A