Django Packages : Workers, Queues, and Tasks

Workers, Queues, and Tasks

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

Features currently being evaluated

Feature	Description
Synopsis	Packages' organizational style and method of Django integration
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI	Native support for uWSGI builtin spooler

Filter results

Python 3

Stable

Package	celery	Dramatiq	huey	Django Q	django-rq	Django-celery	Trigger Happy	django-apscheduler	django-celery-results	Celery Progress Bars for Django	django_dramatiq	django-celery-monitor	django-background-tasks	django-task	django-lightweight-queue	django-uwsgi-taskmanager	django-toosimple-q	Django Task API	django-celery-extensions	django-carrot	django-uwsgi-spooler	django-tasker	djcall	modelqueue	django-admin-rq	autotask	django-rq-jobs	django-rq-dashboard	django-pq	django-signalqueue	jobtastic	django-kitsune	django-chronograph

Package	celery	Dramatiq	huey	Django Q	django-rq	Django-celery	Trigger Happy	django-apscheduler	django-celery-results	Celery Progress Bars for Django	django_dramatiq	django-celery-monitor	django-background-tasks	django-task	django-lightweight-queue	django-uwsgi-taskmanager	django-toosimple-q	Django Task API	django-celery-extensions	django-carrot	django-uwsgi-spooler	django-tasker	djcall	modelqueue	django-admin-rq	autotask	django-rq-jobs	django-rq-dashboard	django-pq	django-signalqueue	jobtastic	django-kitsune	django-chronograph
Description	Distributed Task Queue (development branch)	A fast and reliable background task processing library for Python 3.	a little task queue for python	A multiprocessing distributed task queue for Django	A simple app that provides django integration for RQ (Redis Queue)	Old Celery integration project for Django	:snake: Trigger Happy - The bus :bus: for your internet services	APScheduler for Django	Celery result back end with django	Drop in, configurable, dependency-free progress bars for your Django/Celery applications.	A Django app that integrates with Dramatiq.	Celery Monitoring for Django	A database-backed work queue for Django	A Django app to run new background tasks from either admin or cron, and inspect task history from admin	Lightweight & modular queue and cron system for Django	Django application to monitor and manage long and/or recurring tasks through uWSGI.	Simplistic task queue and cron-like scheduler for Django	A REST API and JavaScript library for managing background tasks in Django projects		A lightweight task queue for Django using RabbitMQ	HALTED IN FAVOR OF yourlabs/django-call Task model to get the most out of uWSGI's spooler with minimal effort with CRUDLFA...	Dead simple async task queue. Stores tasks in database.	MOVED to yourlabs.io/oss/djcall !! Spooled and Cron generic task models, like django-q but for uWSGI builtin features	Task queue based on Django models.	Django admin rq is a django package that creates a 4 step (form, preview, main, complete) asynchronous workflow from ...		Provides scheduled jobs management from the Django Admin using Django-RQ	A dashboard for managing RQ in the Django admin	[UNMAINTAINED] A task queue based on the elegant python RQ but with a django postgresql backend.	Truly asynchronous Django signals!	Make your user-responsive long-running Celery jobs totally awesomer.	Host server monitoring app for Django Admin. Allows to schedule checks on hosts and notify results to administrators by mail.
Category	Other	App	App	App	App	App	App	App	App	Other	App	App	App	App	App	App	App	App	App	App	App	App	App	Other	App	App	App	App	App	App	Other	App	App
# Using This	10	1	9	20	21	81	5	0	0	0	0	1	1	1	0	1	0	0	0	1	0	0	0	0	1	1	1	2	0	1	1	1	1
Python 3?
Development Status	Production/Stable	Unknown	Beta	Production/Stable	Beta	Production/Stable	Production/Stable	Beta	Production/Stable	Unknown	Unknown	Production/Stable	Production/Stable	Production/Stable	Production/Stable	Beta	Alpha	Unknown	Alpha	Production/Stable	Planning	Beta	Pre-Alpha	Alpha	Beta	Beta	Beta	Alpha	Alpha	Beta	Beta	Unknown	Unknown
Last updated	Jan. 13, 2022, 9:28 a.m.	Jan. 16, 2022, 3:18 a.m.	Jan. 10, 2022, 12:30 p.m.	June 26, 2021, 8:04 a.m.	Dec. 6, 2021, 7:44 p.m.	Nov. 27, 2021, 12:20 a.m.	May 1, 2020, 8:07 a.m.	Nov. 17, 2021, 12:40 a.m.	Jan. 5, 2022, 11:51 p.m.	Dec. 23, 2021, 7:09 a.m.	Dec. 20, 2021, 1:29 a.m.	Nov. 10, 2021, 6:41 a.m.	Dec. 23, 2019, 9:34 a.m.	June 13, 2021, 6:05 p.m.	Dec. 9, 2021, 5:45 a.m.	May 4, 2021, 3:52 p.m.	July 15, 2021, 5:04 p.m.	Sept. 10, 2021, 5:58 p.m.	Jan. 7, 2022, 9:54 a.m.	April 14, 2019, 3:56 p.m.	Aug. 2, 2018, 9:35 a.m.	April 17, 2019, 9:31 a.m.	Sept. 20, 2018, 11:54 a.m.	April 19, 2018, 7:49 p.m.	Nov. 2, 2017, 9:15 a.m.	Aug. 11, 2016, 9:01 a.m.	July 29, 2015, 8:34 a.m.	June 13, 2017, 11:10 a.m.	Oct. 12, 2014, 10:39 p.m.	Jan. 20, 2014, 9:44 p.m.	May 8, 2019, 9:48 a.m.	Nov. 6, 2014, 9:54 a.m.	March 5, 2013, 11:39 p.m.
Version	5.2.3	1.12.2	2.4.3	1.3.9	2.5.1	3.3.1	1.7.0	0.6.0	2.2.0	0.1.1	0.10.0	1.1.2	1.2.5	2.0.1	4.1.0	2.2.12	0.3.1	1.2.5	0.0.30	1.5.0	0.0.0	0.2.60	0.2.0	1.0.3	0.2.0	0.5.4	0.1.5.1	0.3.3	0.3.2	0.5.1	2.1.1	0.2.3	0.3.1
Repo	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	Bitbucket	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	Bitbucket
Commits
Stars	18509	2886	3797	1426	1474	1441	1355	459	416	300	215	147	527	36	21	21	6	6	3	61	n/a	1	2	2	6	8	30	86	68	54	639	66	62
Repo Forks	4184	215	331	212	252	455	129	79	153	73	54	58	112	6	3	3	n/a	2	2	13	n/a	n/a	n/a	1	2	5	6	30	7	4	58	13	35
Participants	ask thedrow auvipy mher ionelmc piotrmaslanka nvie maybe-sybr mchataigner graingert more...	Bogdanp rpkilby FinnLidbetter ryansm1 gdvalle takhs91 davidt99 bersace rouge8 najamansari more...	coleifer jbaiter antwan camilonova blablacio logannc adamchainz gl3nn hgdeoro jedie more...	Koed00 Eagllus jmcvetta danielwelch janneronkko timomeara yannpom benjaoming kennyhei telmobarros more...	selwin dependabot-preview[bot] lechup SeiryuZ jeanphix Krukov dependabot[bot] acjay hendi therefromhere more...	ask auvipy vytisb ionelmc diegueus9 thedrow jezdez jasonbaker iamjstates piotrbulinski more...	foxmask koalie CrazyLlama Logan1x h-chauhan adrienlachaize philippeowagner pouete Leopere scomert more...	jcass77 jarekwg sallyruthstruik soon Jedore akoltsov-spoton bnjmnhndrsn countable D4VIDB2 daniel-butler more...	auvipy ask thedrow arnau126 pre-commit-ci[bot] AllexVeldman ifmos AlecTroemel jaylynch etnguyen03 more...	czue EJH2 OmarWKH oisinBates ashutoshsingh0223 ivn86 mcrot mobiware timnyborg abedyngash more...	Bogdanp jcass77 rpkilby denizdogan MattBlack85 rakanalh ramonsaraiva Sovetnikov aericson theotherbjorn more...	jezdez pyup-bot janezkranjc jazzband-bot mhsekhavat	philippeowagner lilspikey jvamvas yannik-ammann walterrenner Luthaf Zagrebelin johnsensible december1981 cedricfarinazzo more...	morlandi	PeterJCLaw lamby danpalmer prophile tomokas lirsacc mthpower tavva cbaines hythloday	gabrielelucci guglielmo pauloxnet unusual-thoughts	olivierdalang	nikmolnar dependabot[bot] brendan-ward	matllubos radimsuckr jsilhan	chris104957 ewsterrenburg	jpic	wooyek	jpic	grantjenks	Proper-Job	kbr	Koed00 likeon	brutasse olarin ihuro jleclanche spapas wastrachan nsbk sbussetti	bretth saulshanabrook	fish2000 bitdeli-chef	winhamwr jlward deti midnightlynx rhunwicks caffodian kylegibson abbasovalex georgemarshall singingwolfboy more...	raulgarreta amartinezuy	wnielson
Documentation		N/A			N/A			N/A			N/A				N/A		N/A		N/A		N/A	N/A	N/A		N/A		N/A	N/A	N/A	N/A	N/A	N/A
Synopsis				Multiprocessing worker pool Django native Encrypted and compressed task packages Scheduled tasks Result hooks Result and Failure database Redis, DIsque, IronMQ , SQS, MongoDB or ORM broker Django Admin Multi Cluster Monitor Worker cpu affinity	A simple app that provides django integration for RQ (http://python-rq.org)	Provides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process.						Monitor Celery tasks and workers in the admin. Formerly included in django-celery.		Purposes: - create async tasks either programmatically or from admin - monitor async tasks from admin - log all tasks in the database for later inspection - optionally save task-specific logs in a TextField and/or in a FileField Based on: - django-rq		# Features - Start and stop your tasks via admin - Schedule tasks - Plan tasks as cron items - Check or download the generated reports/logs -Simply write a standard Django Command class (your app doesn't need to interact with Django uWSGI Taskmanager)							Django models to wrap around uWSGI native spooler and cron features.	ModelQueue is an Apache2 licensed task queue based on Django models.			Scheduled jobs management Django Admin plugin using Django-RQ Supports once, daily, weekly, monthly, quarterly and yearly scheduled tasks. Jobs can be limited to a set number of repeats. Both regular tasks and management commands can be scheduled. All tasks are queued to RQ , enabling a large payload schedule without delays.			Define and dispatch asynchronous Django signals, using the same semantics as their inbuilt synchronous counterparts. Originally developed for ImageKit -- https://github.com/jdriscoll/django-imagekit -- to decouple image pipeline processing from view functions. Offers a easily implemented engine API, an extensible JSON-based interprocess protocol; off-the-shelf backends leverage the characteristics of several Redis and relational datastructures.		A Django Admin app to perform host server monitoring. A control panel will be added to the Admin in order to configure hosts, checks and monitor check results. Notification rules can be defined to notify administrator users by mail.	Provides a master hook for the Cron daemon. Periodic tasks can then be defined within the Django admin panel -- no need to mess around with fragile crontab syntax with superuser privileges. Run any Django ./manage.py commands as needed: every minute, every day, or whatever in between.
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI