Workers, Queues, and Tasks

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

Filter results

Package celery Dramatiq huey django-rq Django-celery django-celery-results django-apscheduler Celery Progress Bars for Django Django Q django_dramatiq Django Q2 django-celery-monitor django-task django-lightweight-queue django-toosimple-q django-rq-scheduler django-uwsgi-taskmanager urd django-tasks-scheduler modelqueue django-celery-extensions Django Task API django-tasker django-uwsgi-spooler
Package celery Dramatiq huey django-rq Django-celery django-celery-results django-apscheduler Celery Progress Bars for Django Django Q django_dramatiq Django Q2 django-celery-monitor django-task django-lightweight-queue django-toosimple-q django-rq-scheduler django-uwsgi-taskmanager urd django-tasks-scheduler modelqueue django-celery-extensions Django Task API django-tasker django-uwsgi-spooler
Description Distributed Task Queue
(development branch)
A fast and reliable background
task processing library for
Python 3.
a little task queue for python A simple app that provides
django integration for RQ
(Redis Queue)
Old Celery integration project
for Django
Celery result back end with
django
APScheduler for Django Drop in, configurable,
dependency-free progress bars
for your Django/Celery
applications.
A multiprocessing distributed
task queue for Django
A Django app that integrates
with Dramatiq.
A multiprocessing distributed
task queue for Django based on
Django-Q
Celery Monitoring for Django A Django app to run new
background tasks from either
admin or cron, and inspect
task history from admin
Lightweight & modular queue
and cron system for Django
Simplistic task queue and
cron-like scheduler for Django
A database backed job
scheduler for Django
Django application to monitor
and manage long and/or
recurring tasks through uWSGI.
A scheduler for Django
projects
Schedule async tasks using
redis pub/sub.
Task queue based on Django
models.
A REST API and JavaScript
library for managing
background tasks in Django
projects
Dead simple async task queue.
Stores tasks in database.
HALTED IN FAVOR OF
yourlabs/django-call Task
model to get the most out of
uWSGI's spooler with minimal
effort with CRUDLFA...
Category Other App App App App App App Other App App App App App App App App App App App Other App App App App
# Using This 12 3 9 22 83 0 1 0 25 0 0 1 2 0 0 1 1 1 0 0 0 0 0 0
Python 3?
Development Status Production/Stable Unknown Production/Stable Beta Production/Stable Production/Stable Beta Unknown Production/Stable Unknown Production/Stable Production/Stable Production/Stable Production/Stable Alpha Production/Stable Beta Production/Stable Production/Stable Beta Alpha Unknown Beta Planning
Last updated July 4, 2023, 6:25 a.m. June 11, 2023, 5:33 a.m. June 23, 2023, 7:15 p.m. June 1, 2023, 11:24 p.m. Aug. 20, 2022, 12:17 a.m. June 22, 2023, 2:27 a.m. July 22, 2022, 9:21 a.m. April 3, 2023, 11:35 a.m. June 26, 2021, 8:04 a.m. July 4, 2023, 12:16 p.m. July 1, 2023, 8:47 p.m. Nov. 10, 2021, 6:41 a.m. Feb. 17, 2023, 12:31 p.m. June 28, 2023, 9:50 a.m. Feb. 23, 2023, 3:55 p.m. July 1, 2023, 2:38 p.m. Jan. 15, 2023, 7:18 p.m. Jan. 30, 2023, 4:56 a.m. July 2, 2023, 10:30 a.m. March 31, 2022, 5:59 p.m. Jan. 25, 2023, 7:18 a.m. March 7, 2022, 6:37 p.m. April 17, 2019, 9:31 a.m. Aug. 2, 2018, 9:35 a.m.
Version 5.3.1 1.14.2 2.4.5 2.8.1 3.3.1 2.5.1 0.6.2 0.3 1.3.9 0.11.2 1.5.4 1.1.2 2.0.6 4.11.0 0.4.0 2023.6.2 2.3.5 1.0.3 1.0.0 2.2.1 0.0.38 1.4.1 0.2.60 0.0.0
Repo GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub
Commits
Stars 21,785 3,638 4,530 1,669 1,498 576 598 395 1,722 285 137 175 51 40 29 23 22 7 3 6 4 7 1 0
Repo Forks 4,518 258 365 272 471 190 90 92 250 69 11 61 9 6 3 8 3 0 0 3 2 4 1 0
Participants ask
thedrow
auvipy
mher
Nusnus
ionelmc
piotrmaslanka
pre-commit-ci[bot]
nvie
maybe-sybr
more...
Bogdanp
FinnLidbetter
ryansm1
gdvalle
takhs91
davidt99
bersace
orsinium
rouge8
kurtmckee
more...
coleifer
jbaiter
antwan
camilonova
blablacio
adamchainz
logannc
gl3nn
hgdeoro
jedie
more...
selwin
dependabot-preview[bot]
lechup
SeiryuZ
dependabot[bot]
jeanphix
Krukov
acjay
hendi
therefromhere
more...
ask
auvipy
vytisb
ionelmc
diegueus9
thedrow
jezdez
jasonbaker
iamjstates
piotrbulinski
more...
auvipy
ask
pre-commit-ci[bot]
thedrow
arnau126
AllexVeldman
ifmos
intgr
AlecTroemel
jaylynch
more...
jcass77
jarekwg
sallyruthstruik
soon
calledbert
akoltsov-spoton
bnjmnhndrsn
countable
D4VID0x2
daniel-butler
more...
czue
EJH2
OmarWKH
giovcandido
oisinBates
ashutoshsingh0223
ivn86
mcrot
mobiware
timnyborg
more...
Koed00
Eagllus
jmcvetta
danielwelch
janneronkko
timomeara
yannpom
benjaoming
kennyhei
telmobarros
more...
Bogdanp
amureki
jcass77
ashleyatlas
denizdogan
MattBlack85
rakanalh
ramonsaraiva
Sovetnikov
albertocerrone
more...
Koed00
GDay
Eagllus
jmcvetta
danielwelch
janneronkko
timomeara
msabatier
yannpom
benjaoming
more...
jezdez
pyup-bot
janezkranjc
jazzband-bot
mohammad7t
morlandi PeterJCLaw
lamby
danpalmer
prophile
lirsacc
tomokas
mthpower
dependabot[bot]
itsthejoker
tavva
more...
olivierdalang cunla
dependabot[bot]
g3rd
frbry
tom-price
gabriels1234
unterwegi
bashhack
oudeismetis
gavaig
more...
guglielmo
gabrielelucci
pauloxnet
unusual-thoughts
boxed cunla
dependabot[bot]
grantjenks matllubos
radimsuckr
jsilhan
nikmolnar
dependabot[bot]
brendan-ward
JensTimmerman
wooyek jpic
Documentation n/a n/a n/a n/a n/a n/a n/a n/a n/a n/a
Synopsis A simple app that provides django integration for RQ (http://python-rq.org) Provides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process. Multiprocessing worker pool

Django native

Encrypted and compressed task packages

Scheduled tasks

Result hooks

Result and Failure database

Redis, DIsque, IronMQ , SQS, MongoDB or ORM broker

Django Admin

Multi Cluster Monitor

Worker cpu affinity
Monitor Celery tasks and workers in the admin. Formerly included in django-celery. Purposes:

- create async tasks either programmatically or from admin

- monitor async tasks from admin

- log all tasks in the database for later inspection

- optionally save task-specific logs in a TextField and/or in a FileField


Based on:
- django-rq
# Features

- Start and stop your tasks via admin

- Schedule tasks

- Plan tasks as cron items

- Check or download the generated reports/logs

-Simply write a standard Django Command class (your app doesn't need to interact with Django uWSGI Taskmanager)
ModelQueue is an Apache2 licensed task queue based on Django models.
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI

Features currently being evaluated

Feature Description
Synopsis Packages' organizational style and method of Django integration
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI Native support for uWSGI builtin spooler
Search Weight Package Description Last PyPI release: Repo Forks Stars
{{ item.weight / max_weight * 100 | number:0 }}% {{ item.title }} Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A