Workers, Queues, and Tasks

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

Filter results

Package celery Dramatiq huey django-rq django-celery-results Celery Progress Bars for Django django-apscheduler Django Q2 django_dramatiq Django-celery django-lightweight-queue django-toosimple-q django-task django-rq-scheduler django-celery-monitor urd django-tasks-scheduler django-uwsgi-taskmanager django-q-registry django-celery-extensions modelqueue django-tasker Django Task API django-uwsgi-spooler Django Q
Package celery Dramatiq huey django-rq django-celery-results Celery Progress Bars for Django django-apscheduler Django Q2 django_dramatiq Django-celery django-lightweight-queue django-toosimple-q django-task django-rq-scheduler django-celery-monitor urd django-tasks-scheduler django-uwsgi-taskmanager django-q-registry django-celery-extensions modelqueue django-tasker Django Task API django-uwsgi-spooler Django Q
Description Distributed Task Queue
(development branch)
A fast and reliable background
task processing library for
Python 3.
a little task queue for python A simple app that provides
django integration for RQ
(Redis Queue)
Celery result back end with
django
Drop in, configurable,
dependency-free progress bars
for your Django/Celery
applications.
APScheduler for Django A multiprocessing distributed
task queue for Django based on
Django-Q
A Django app that integrates
with Dramatiq.
Old Celery integration project
for Django
Lightweight & modular queue
and cron system for Django
Simplistic task queue and
cron-like scheduler for Django
A Django app to run new
background tasks from either
admin or cron, and inspect
task history from admin
Package migrated to
https://github.com/dsoftwareinc/django-tasks-scheduler
Celery Monitoring for Django A scheduler for Django
projects
Schedule async tasks using
redis pub/sub.
Django application to monitor
and manage long and/or
recurring tasks through uWSGI.
A Django app to register
periodic Django Q tasks
Task queue based on Django
models.
Dead simple async task queue.
Stores tasks in database.
A REST API and JavaScript
library for managing
background tasks in Django
projects
HALTED IN FAVOR OF
yourlabs/django-call Task
model to get the most out of
uWSGI's spooler with minimal
effort with CRUDLFA...
A multiprocessing distributed
task queue for Django
Category Other App App App App Other App App App App App App App App App App App App App App Other App App App App
# Using This 13 3 10 23 0 0 2 3 0 84 0 0 2 0 1 1 1 1 0 0 0 0 0 0 26
Python 3?
Development Status Production/Stable Unknown Production/Stable Beta Production/Stable Unknown Beta Production/Stable Unknown Production/Stable Production/Stable Alpha Production/Stable Production/Stable Production/Stable Production/Stable Production/Stable Beta n/a Alpha Beta Beta Unknown Planning Production/Stable
Last updated Feb. 25, 2024, 4:13 a.m. Feb. 10, 2024, 2:58 a.m. Jan. 23, 2024, 10:33 a.m. Jan. 17, 2024, 8:14 p.m. Nov. 8, 2023, 9:50 a.m. Jan. 24, 2024, 9:13 a.m. July 22, 2022, 9:21 a.m. Feb. 20, 2024, 12:04 p.m. Dec. 12, 2023, 7:37 a.m. Aug. 20, 2022, 12:17 a.m. Dec. 14, 2023, 9:47 a.m. Feb. 9, 2024, 9:31 a.m. Feb. 17, 2023, 12:31 p.m. Sept. 1, 2023, 11:30 a.m. Nov. 10, 2021, 6:41 a.m. Nov. 21, 2023, 5:10 a.m. Feb. 13, 2024, 9:58 a.m. Jan. 15, 2023, 7:18 p.m. Feb. 20, 2024, 5:40 p.m. Jan. 25, 2023, 7:18 a.m. March 31, 2022, 5:59 p.m. April 17, 2019, 9:31 a.m. March 7, 2022, 6:37 p.m. Aug. 2, 2018, 9:35 a.m. June 26, 2021, 8:04 a.m.
Version 5.3.6 1.16.0 2.5.0 2.10.1 2.5.1 0.3 0.6.2 1.6.1 0.11.6 3.3.1 4.11.0 0.4.0 2.0.6 2023.6.2 1.1.2 1.3.0 1.3.1 2.3.5 n/a 0.0.38 2.2.1 0.2.60 1.4.1 0.0.0 1.3.9
Repo GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub GitHub
Commits
Stars 23,096 3,954 4,817 1,740 640 427 632 228 316 1,514 44 33 56 24 191 15 13 23 6 4 6 1 7 0 1,783
Repo Forks 4,556 278 397 277 202 93 91 23 74 462 6 5 10 8 65 0 5 3 0 3 3 1 4 0 269
Participants ask
thedrow
auvipy
Nusnus
mher
ionelmc
pre-commit-ci[bot]
piotrmaslanka
pyup-bot
nvie
more...
Bogdanp
FinnLidbetter
jenstroeger
ryansm1
gdvalle
takhs91
davidt99
bersace
orsinium
viiicky
more...
coleifer
jbaiter
antwan
camilonova
blablacio
adamchainz
logannc
tirkarthi
oz123
miohtama
more...
selwin
dependabot-preview[bot]
dependabot[bot]
lechup
SeiryuZ
jeanphix
Krukov
acjay
therefromhere
hendi
more...
auvipy
ask
pre-commit-ci[bot]
thedrow
arnau126
AllexVeldman
ifmos
intgr
AlecTroemel
jaylynch
more...
czue
EJH2
OmarWKH
giovcandido
oisinBates
ashutoshsingh0223
ivn86
mcrot
mobiware
timnyborg
more...
jcass77
jarekwg
sallyruthstruik
soon
calledbert
redstoneleo
nialllo
missterr
luto
bluetech
more...
Koed00
GDay
Eagllus
jmcvetta
danielwelch
janneronkko
timomeara
msabatier
yannpom
valentinogagliardi
more...
Bogdanp
amureki
jcass77
ashleybartlett
denizdogan
pickfire
MattBlack85
rakanalh
ramonsaraiva
Sovetnikov
more...
ask
auvipy
vytisb
ionelmc
diegueus9
thedrow
nuklea
zpencerq
rockallite
iamjstates
more...
PeterJCLaw
lamby
danpalmer
prophile
lirsacc
tomokas
itsthejoker
mthpower
dependabot[bot]
tavva
more...
olivierdalang
rexzhang
morlandi cunla
dependabot[bot]
g3rd
frbry
tom-price
gabriels1234
unterwegi
bashhack
oudeismetis
gavaig
more...
jezdez
pyup-bot
janezkranjc
jazzband-bot
mohammad7t
boxed cunla
dependabot[bot]
rstalbow
dirkmueller
mbi
cyber237
rwielk
gabriels1234
guglielmo
gabrielelucci
pauloxnet
unusual-thoughts
joshuadavidthomas
pre-commit-ci[bot]
matllubos
radimsuckr
grantjenks wooyek nikmolnar
dependabot[bot]
brendan-ward
JensTimmerman
jpic Koed00
Eagllus
jmcvetta
danielwelch
janneronkko
timomeara
yannpom
benjaoming
kennyhei
telmobarros
more...
Documentation n/a n/a n/a n/a n/a n/a n/a n/a n/a n/a
Synopsis A simple app that provides django integration for RQ (http://python-rq.org) Provides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process. Purposes:

- create async tasks either programmatically or from admin

- monitor async tasks from admin

- log all tasks in the database for later inspection

- optionally save task-specific logs in a TextField and/or in a FileField


Based on:
- django-rq
Monitor Celery tasks and workers in the admin. Formerly included in django-celery. # Features

- Start and stop your tasks via admin

- Schedule tasks

- Plan tasks as cron items

- Check or download the generated reports/logs

-Simply write a standard Django Command class (your app doesn't need to interact with Django uWSGI Taskmanager)
ModelQueue is an Apache2 licensed task queue based on Django models. Multiprocessing worker pool

Django native

Encrypted and compressed task packages

Scheduled tasks

Result hooks

Result and Failure database

Redis, DIsque, IronMQ , SQS, MongoDB or ORM broker

Django Admin

Multi Cluster Monitor

Worker cpu affinity
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI

View all grid packages

Features currently being evaluated

Feature Description
Synopsis Packages' organizational style and method of Django integration
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI Native support for uWSGI builtin spooler
Search Weight Package Description Last PyPI release: Repo Forks Stars
{{ item.weight / max_weight * 100 | number:0 }}% {{ item.title }} Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A