Django Packages : Workers, Queues, and Tasks

Workers, Queues, and Tasks

Apps and services for running your Django apps in various parallel environments to the web server, freeing your project architecture from the HTTP-based service lifecycle:

* Construct daemons to batch-process large datasets
* Call functions on a recurring schedule
* Respond to system events
* Sync with external data sources without beach-balling

Use existing components (models, templates, &c) and your favorite Django design patterns in these new contexts as you need -- while including Pythonic batteries from disciplines beyond web development.

Features currently being evaluated

Feature	Description
Synopsis	Packages' organizational style and method of Django integration
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI	Native support for uWSGI builtin spooler

Filter results

Python 3

Stable

Package	celery	Dramatiq	huey	Django-celery	Django Q	django-rq	django-celery-results	django-apscheduler	Celery Progress Bars for Django	Trigger Happy	django_dramatiq	django-celery-monitor	django-task	django-lightweight-queue	django-uwsgi-taskmanager	django-toosimple-q	django-rq-scheduler	Django Task API	modelqueue	django-celery-extensions

Package	celery	Dramatiq	huey	Django-celery	Django Q	django-rq	django-celery-results	django-apscheduler	Celery Progress Bars for Django	Trigger Happy	django_dramatiq	django-celery-monitor	django-task	django-lightweight-queue	django-uwsgi-taskmanager	django-toosimple-q	django-rq-scheduler	Django Task API	modelqueue	django-celery-extensions
Description	Distributed Task Queue (development branch)	A fast and reliable background task processing library for Python 3.	a little task queue for python	Old Celery integration project for Django	A multiprocessing distributed task queue for Django	A simple app that provides django integration for RQ (Redis Queue)	Celery result back end with django	APScheduler for Django	Drop in, configurable, dependency-free progress bars for your Django/Celery applications.	:snake: Trigger Happy - The bus :bus: for your internet services	A Django app that integrates with Dramatiq.	Celery Monitoring for Django	A Django app to run new background tasks from either admin or cron, and inspect task history from admin	Lightweight & modular queue and cron system for Django	Django application to monitor and manage long and/or recurring tasks through uWSGI.	Simplistic task queue and cron-like scheduler for Django	A database backed job scheduler for Django RQ with Django	A REST API and JavaScript library for managing background tasks in Django projects	Task queue based on Django models.
Category	Other	App	App	App	App	App	App	App	Other	App	App	App	App	App	App	App	App	App	Other	App
# Using This	10	1	9	83	21	22	0	0	0	5	0	1	2	0	1	0	0	0	0	0
Python 3?
Development Status	Production/Stable	Unknown	Beta	Production/Stable	Production/Stable	Beta	Production/Stable	Beta	Unknown	Production/Stable	Unknown	Production/Stable	Production/Stable	Production/Stable	Beta	Alpha	Production/Stable	Unknown	Beta	Alpha
Last updated	June 26, 2022, 5:59 a.m.	June 17, 2022, 1:40 a.m.	June 13, 2022, 8:52 a.m.	June 18, 2022, 9:41 p.m.	June 26, 2021, 8:04 a.m.	Jan. 23, 2022, 10:07 p.m.	June 22, 2022, 4:50 a.m.	March 5, 2022, 11:21 p.m.	Feb. 11, 2022, 6:42 a.m.	May 1, 2020, 8:07 a.m.	June 11, 2022, 11:33 a.m.	Nov. 10, 2021, 6:41 a.m.	April 8, 2022, 4:34 a.m.	June 27, 2022, 7:02 a.m.	Oct. 6, 2021, 2:28 p.m.	March 29, 2022, 5:26 p.m.	June 24, 2022, 8:16 a.m.	March 7, 2022, 6:37 p.m.	March 31, 2022, 5:59 p.m.	March 14, 2022, 1:19 p.m.
Version	5.2.7	1.13.0	2.4.3	3.3.1	1.3.9	2.5.1	2.3.1	0.6.2	0.1.2	1.7.0	0.11.0	1.1.2	2.0.5	4.5.1	2.2.14	0.4.0	2022.6.2	1.4.1	2.2.1	0.0.31
Repo	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub	GitHub
Commits
Stars	19,594	3,139	4,105	1,457	1,532	1,531	469	511	338	1,347	236	157	43	23	22	12	7	8	3	4
Repo Forks	4,312	228	347	462	223	254	170	86	78	129	59	62	6	4	3	0	2	4	2	2
Participants	ask thedrow auvipy mher ionelmc piotrmaslanka nvie maybe-sybr mchataigner graingert more...	Bogdanp rpkilby FinnLidbetter ryansm1 gdvalle takhs91 davidt99 bersace rouge8 kurtmckee more...	coleifer jbaiter antwan camilonova blablacio adamchainz logannc gl3nn hgdeoro jedie more...	ask auvipy vytisb ionelmc diegueus9 thedrow jezdez jasonbaker iamjstates piotrbulinski more...	Koed00 Eagllus jmcvetta danielwelch janneronkko timomeara yannpom benjaoming kennyhei telmobarros more...	selwin dependabot-preview[bot] lechup SeiryuZ jeanphix Krukov dependabot[bot] acjay hendi therefromhere more...	auvipy ask thedrow pre-commit-ci[bot] arnau126 AllexVeldman ifmos AlecTroemel jaylynch etnguyen03 more...	jcass77 jarekwg sallyruthstruik soon Jedore akoltsov-spoton bnjmnhndrsn countable D4VID0x2 daniel-butler more...	czue EJH2 OmarWKH oisinBates ashutoshsingh0223 ivn86 mcrot mobiware timnyborg abedyngash more...	foxmask koalie CrazyLlama Logan1x h-chauhan adrienlachaize philippeowagner pouete Leopere scomert more...	Bogdanp jcass77 rpkilby denizdogan MattBlack85 rakanalh ramonsaraiva Sovetnikov aericson theotherbjorn more...	jezdez pyup-bot janezkranjc jazzband-bot mhsekhavat	morlandi	PeterJCLaw lamby danpalmer prophile tomokas lirsacc mthpower tavva cbaines itsthejoker more...	gabrielelucci guglielmo pauloxnet unusual-thoughts	olivierdalang	cunla g3rd frbry tom-price unterwegi bashhack dependabot[bot] oudeismetis jcarbaugh josephabrahams more...	nikmolnar dependabot[bot] brendan-ward JensTimmerman	grantjenks	matllubos radimsuckr jsilhan
Documentation						n/a		n/a			n/a			n/a		n/a	n/a			n/a
Synopsis				Provides a decorator syntax for defining tasks, which run in worker instances of your app, and a backend-agnostic protocol for serializing data between these workers and the web process.	Multiprocessing worker pool Django native Encrypted and compressed task packages Scheduled tasks Result hooks Result and Failure database Redis, DIsque, IronMQ , SQS, MongoDB or ORM broker Django Admin Multi Cluster Monitor Worker cpu affinity	A simple app that provides django integration for RQ (http://python-rq.org)						Monitor Celery tasks and workers in the admin. Formerly included in django-celery.	Purposes: - create async tasks either programmatically or from admin - monitor async tasks from admin - log all tasks in the database for later inspection - optionally save task-specific logs in a TextField and/or in a FileField Based on: - django-rq		# Features - Start and stop your tasks via admin - Schedule tasks - Plan tasks as cron items - Check or download the generated reports/logs -Simply write a standard Django Command class (your app doesn't need to interact with Django uWSGI Taskmanager)				ModelQueue is an Apache2 licensed task queue based on Django models.
Redis Queue
Disque
Django ORM support
ZeroMQ
uWSGI