Workers, Queues, and Tasks

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

Filter results

Package celery Dramatiq huey django-rq django-celery-results Celery Progress Bars for Django django-apscheduler Django-celery django_dramatiq Django Q2 Django Q django-task django-celery-monitor django-lightweight-queue django-toosimple-q django-rq-scheduler django-uwsgi-taskmanager django-tasks-scheduler urd modelqueue django-celery-extensions django-tasker django-uwsgi-spooler Django Task API
Package celery Dramatiq huey django-rq django-celery-results Celery Progress Bars for Django django-apscheduler Django-celery django_dramatiq Django Q2 Django Q django-task django-celery-monitor django-lightweight-queue django-toosimple-q django-rq-scheduler django-uwsgi-taskmanager django-tasks-scheduler urd modelqueue django-celery-extensions django-tasker django-uwsgi-spooler Django Task API
Description Distributed Task Queue
(development branch)
A fast and reliable background
task processing library for
Python 3.
a little task queue for python A simple app that provides
django integration for RQ
(Redis Queue)
Celery result back end with
django
Drop in, configurable,
dependency-free progress bars
for your Django/Celery
applications.
APScheduler for Django Old Celery integration project
for Django
A Django app that integrates
with Dramatiq.
A multiprocessing distributed
task queue for Django based on
Django-Q
A multiprocessing distributed
task queue for Django
A Django app to run new
background tasks from either
admin or cron, and inspect
task history from admin
Celery Monitoring for Django Lightweight & modular queue
and cron system for Django
Simplistic task queue and
cron-like scheduler for Django
Package migrated to
https://github.com/dsoftwareinc/django-tasks-scheduler
Django application to monitor
and manage long and/or
recurring tasks through uWSGI.
Schedule async tasks using
redis pub/sub.
A scheduler for Django
projects
Task queue based on Django
models.
Dead simple async task queue.
Stores tasks in database.
HALTED IN FAVOR OF
yourlabs/django-call Task
model to get the most out of
uWSGI's spooler with minimal
effort with CRUDLFA...
A REST API and JavaScript
library for managing
background tasks in Django
projects
Category Other App App App App Other App App App App App App App App App App App App App Other App App App App
# Using This 13 3 10 22 0 0 2 83 0 3 26 2 1 0 0 0 1 1 1 0 0 0 0 0
Python 3?
Development Status Production/Stable Unknown Production/Stable Beta Production/Stable Unknown Beta Production/Stable Unknown Production/Stable Production/Stable Production/Stable Production/Stable Production/Stable Alpha Production/Stable Beta Production/Stable Production/Stable Beta Alpha Beta Planning Unknown
Last updated Dec. 2, 2023, 1:27 a.m. Nov. 6, 2023, 1:10 a.m. Nov. 27, 2023, 9:39 p.m. Nov. 26, 2023, 6:34 a.m. Nov. 8, 2023, 9:50 a.m. April 3, 2023, 11:35 a.m. July 22, 2022, 9:21 a.m. Aug. 20, 2022, 12:17 a.m. Oct. 11, 2023, 11:01 a.m. Nov. 4, 2023, 2:52 p.m. June 26, 2021, 8:04 a.m. Feb. 17, 2023, 12:31 p.m. Nov. 10, 2021, 6:41 a.m. July 17, 2023, 8:10 a.m. Sept. 13, 2023, 10:10 a.m. Sept. 1, 2023, 11:30 a.m. Jan. 15, 2023, 7:18 p.m. Nov. 30, 2023, 12:44 p.m. Nov. 21, 2023, 5:10 a.m. March 31, 2022, 5:59 p.m. Jan. 25, 2023, 7:18 a.m. April 17, 2019, 9:31 a.m. Aug. 2, 2018, 9:35 a.m. March 7, 2022, 6:37 p.m.
Version 5.3.4 1.14.2 2.5.0 2.8.1 2.5.1 0.3 0.6.2 3.3.1 0.11.5 1.6.1 1.3.9 2.0.6 1.1.2 4.11.0 0.4.0 2023.6.2 2.3.5 1.2.3 1.0.3 2.2.1 0.0.38 0.2.60 0.0.0 1.4.1
Repo GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub
Commits
Stars 22,621 3,844 4,705 1,709 619 416 619 1,510 306 189 1,765 53 183 41 31 24 22 12 9 6 4 1 0 7
Repo Forks 4,588 272 397 276 195 93 91 466 71 17 263 10 62 6 4 8 3 2 0 3 2 1 0 4
Participants ask
thedrow
auvipy
Nusnus
mher
ionelmc
pre-commit-ci[bot]
piotrmaslanka
nvie
maybe-sybr
more...
Bogdanp
FinnLidbetter
jenstroeger
ryansm1
gdvalle
takhs91
davidt99
bersace
orsinium
rouge8
more...
coleifer
jbaiter
antwan
camilonova
blablacio
adamchainz
logannc
gl3nn
hgdeoro
jedie
more...
selwin
dependabot-preview[bot]
lechup
dependabot[bot]
SeiryuZ
jeanphix
Krukov
acjay
hendi
therefromhere
more...
auvipy
ask
pre-commit-ci[bot]
thedrow
arnau126
AllexVeldman
ifmos
intgr
AlecTroemel
jaylynch
more...
czue
EJH2
OmarWKH
giovcandido
oisinBates
ashutoshsingh0223
ivn86
mcrot
mobiware
timnyborg
more...
jcass77
jarekwg
sallyruthstruik
soon
calledbert
akoltsov-spoton
bnjmnhndrsn
countable
D4VID0x2
daniel-butler
more...
ask
auvipy
vytisb
ionelmc
diegueus9
thedrow
jezdez
jasonbaker
iamjstates
rockallite
more...
Bogdanp
amureki
jcass77
ashleybartlett
denizdogan
pickfire
MattBlack85
rakanalh
ramonsaraiva
Sovetnikov
more...
Koed00
GDay
Eagllus
jmcvetta
danielwelch
janneronkko
timomeara
msabatier
yannpom
benjaoming
more...
Koed00
Eagllus
jmcvetta
danielwelch
janneronkko
timomeara
yannpom
benjaoming
kennyhei
telmobarros
more...
morlandi jezdez
pyup-bot
janezkranjc
jazzband-bot
mohammad7t
PeterJCLaw
lamby
danpalmer
prophile
lirsacc
tomokas
mthpower
dependabot[bot]
itsthejoker
tavva
more...
olivierdalang cunla
dependabot[bot]
g3rd
frbry
tom-price
gabriels1234
unterwegi
bashhack
oudeismetis
gavaig
more...
guglielmo
gabrielelucci
pauloxnet
unusual-thoughts
cunla
dependabot[bot]
rstalbow
rwielk
gabriels1234
boxed grantjenks matllubos
radimsuckr
jsilhan
wooyek jpic nikmolnar
dependabot[bot]
brendan-ward
JensTimmerman
Documentation n/a n/a n/a n/a n/a n/a n/a n/a n/a n/a
Synopsis A simple app that provides django integration for RQ (http://python-rq.org) Provides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process. Multiprocessing worker pool

Django native

Encrypted and compressed task packages

Scheduled tasks

Result hooks

Result and Failure database

Redis, DIsque, IronMQ , SQS, MongoDB or ORM broker

Django Admin

Multi Cluster Monitor

Worker cpu affinity
Purposes:

- create async tasks either programmatically or from admin

- monitor async tasks from admin

- log all tasks in the database for later inspection

- optionally save task-specific logs in a TextField and/or in a FileField


Based on:
- django-rq
Monitor Celery tasks and workers in the admin. Formerly included in django-celery. # Features

- Start and stop your tasks via admin

- Schedule tasks

- Plan tasks as cron items

- Check or download the generated reports/logs

-Simply write a standard Django Command class (your app doesn't need to interact with Django uWSGI Taskmanager)
ModelQueue is an Apache2 licensed task queue based on Django models.
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI

View all grid packages

Features currently being evaluated

Feature Description
Synopsis Packages' organizational style and method of Django integration
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI Native support for uWSGI builtin spooler
Search Weight Package Description Last PyPI release: Repo Forks Stars
{{ item.weight / max_weight * 100 | number:0 }}% {{ item.title }} Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A