Data Tools

Apps, packages, and modules related to data management: import/export, fixtures, serialization and formats, handling large QuerySets, etc.

Features currently being evaluated

FeatureDescription
Fixtures Saving the lists of fixtures then checking which fixtures were already loaded
allows to execute Selenium tests partially, increasing the speed of test
development.
Synchronization
Querying Implements FilteredRawQuerySet which supersedes Django RawQuerySet with
.filter() / .exclude() / .order_by() and SQL-level slicing.
Implements ListQuerySet for Python lists, including prefetched reverse
relationships.
Backup
Import
Used For FilteredRawQuerySet allows to use raw SELECT for Django paginator.
ListQuerySet allows to use Python lists (including prefetched reverse
relationships) in Django ORM calls and for Django paginator.
Export
Package django-debug-toolbar django-import-export djongo Django REST Pandas django-pandas lifter django-mysql django-adminactions django-smuggler Django Fixture Magic Django Data Wizard python-benedict django-pivot django-spaghetti-and-meatballs django-batch-select django-prefetch django-queryset-transform django-aggregate-if django-developer-panel django-jinja-knockout django-tablib django-redis-metrics django web profiler django-synchro django-excel-response Tiote Database Management Tool django-funky-sheets django-preferences django-model-values django-admin-customizer IterTable django-dbdump Django Natural Keys django-feedmapper django-separated vera django-archive similarityPy django-queryable-properties sqlbuilder XDump django-easydump django-delegate Export data to file (with select fields) django-queryset-decorator Django Nsync Django Debug Requests & Responses (DDRR) data-migrator django-undeletable Django Light Draft requery datapurge django-carrier-pigeon djipsum Django Tarantool django-dumbo any2any django-tables-cleaner django-janitor Django Redis Admin Django Obfuscate Django Controlled Vocabulary aristotle-metadata-registry
Package django-debug-toolbar django-import-export djongo Django REST Pandas django-pandas lifter django-mysql django-adminactions django-smuggler Django Fixture Magic Django Data Wizard python-benedict django-pivot django-spaghetti-and-meatballs django-batch-select django-prefetch django-queryset-transform django-aggregate-if django-developer-panel django-jinja-knockout django-tablib django-redis-metrics django web profiler django-synchro django-excel-response Tiote Database Management Tool django-funky-sheets django-preferences django-model-values django-admin-customizer IterTable django-dbdump Django Natural Keys django-feedmapper django-separated vera django-archive similarityPy django-queryable-properties sqlbuilder XDump django-easydump django-delegate Export data to file (with select fields) django-queryset-decorator Django Nsync Django Debug Requests & Responses (DDRR) data-migrator django-undeletable Django Light Draft requery datapurge django-carrier-pigeon djipsum Django Tarantool django-dumbo any2any django-tables-cleaner django-janitor Django Redis Admin Django Obfuscate Django Controlled Vocabulary aristotle-metadata-registry
Description A configurable set of panels
that display various debug
information about the current
request/response.
Django application and library
for importing and exporting
data with admin integration.
Django and MongoDB database
connector
📊📈 Serves up Pandas dataframes
via the Django REST Framework
for use in client-side (i.e.
d3.js) visualizations and
offline analysis ...
Tools for working with pandas
in your Django projects
A generic query engine,
inspired by Django ORM
:dolphin: :horse: Extensions
to Django for use with
MySQL/MariaDB
collection of useful django
actions to use with ModelAdmin
or AdminSi...
Django Smuggler is a pluggable
application for Django Web
Framework that helps you to
import/export fixtures via the
automatically-generated
administration ...
Utilities to extract and
manipulate Django Fixtures.
🧙⚙️ Import structured data
(e.g. Excel, CSV, XML, JSON)
into one or more Django models
via an interactive web-based
wizard
dict subclass with
keylist/keypath support, I/O
shortcuts (base64, csv, json,
pickle, plist, query-string,
toml, xml, yaml) and many
utilities. :blue_book:
A module for pivoting Django
Querysets
Its a spicy meatball for
serving up fresh hot
entity-relationship diagrams
straight from your django
models.
batch select many-to-many and
one-to-many fields (to help
avoid n+1 query problem)
Generic model related data
prefetch framework for Django.
Experimental .transform(fn)
method for Django QuerySets,
for clever lazily evaluated
optimisations.
Conditional aggregates for
Django queries, just like the
famous SumIf and CountIf in
Excel.
Debug Django applications
directly in Google Chrome
Devtools.
Django datatables and widgets,
both AJAX and traditional.
Display-only ModelForms.
ModelForms / inline formsets
with AJAX submit and
validation. Works ...
django-tablib is a helper
library for Django that allows
Django models to be used to
generate tablib datasets with
introspection ...
Metrics for django apps backed
by Redis.
Django package to log request
values such as device, IP
address, user CPU time, system
CPU time, No of queries, ...
Django app for database data
synchronization.
Django package to easily
render Excel spreadsheets
django database management Django implementation of
Handsontable spreadsheets for
CRUD actions.
Django app allowing users to
set app specific preferences
through the admin interfa...
Taking the O out of ORM. Django admin customizing
interface
⇔ IterTable is a Pythonic API
for iterating through tabular
data formats, including CSV,
XLS, XML, and JSON.
Django management command to
run mysqldump or pg_dump
Enhanced support for natural
keys in Django and Django REST
Framework.
A utility for mapping feeds to
Django models.
Class-based view and mixins
for handling CSV with Django.
📑⚙️ Python/Django reference
implementation of the ERAV
data model
Management command for
creating compressed archives
of Django projects, including
database tables and uploaded
media.
Distance Algorithms Write Django model properties
that can be used in database
queries.
Lightweight Python SQLBuilder.
Can be integrated with Django.
A consistent partial database
copy & load utility
Easily load database snapshots
across deployments
Automatic delegate methods for
Django managers and querysets
without runtime dispatch
penalties.
Export model data (with
selected fields) to csv file
A .decorate(fn) method for
Django QuerySets, for clever
lazily evaluated expressions.
A simple way to keep your
Django Model data 'n-sync with
N external systems.
Print request and response
headers, body (with
pretty-printing), etc.
A declarative data-migration
package
undeletable Django models Preview changes without saving
the data into the database
Store e run queries on
database to help system
manager of a Django website
Simple Django app for managing
data retention.
Export module that catch
modified objects and push them
via some methods (FTP...)
:pencil: Django lorem ipsum
generator - command plugin to
generate (fake content data)
for django
Tarantool database backend for
Django applications.
https://www.tarantool.io
Dumps and loads both the
database and the media files.
NOW MOVED TO :
https://github.com/sebpiq/any2any
A Django app used to remove
oldest records from specific
db tables
django-janitor allows you to
use bleach to clean HTML
stored in a Model's field.
A Django Admin interface for
Redis servers with optional
Redis Sentinel support
Django app to obfuscate text
data.
A Django application to link
your data to standard
vocabularies or your own
controlled lists.
CategoryAppAppOtherAppAppAppAppAppAppAppAppOtherAppAppAppOtherAppOtherOtherFrameworkAppAppAppAppAppAppAppAppOtherAppOtherAppOtherAppOtherAppAppAppOtherAppOtherAppAppAppOtherAppAppOtherAppAppAppAppAppAppAppAppOtherAppAppAppAppAppFramework
# Using This5262261941126250112211011101200000111011110210241110001121013020001
Python 3?
Development Status Production/Stable Unknown Alpha Production/Stable Alpha Pre-Alpha Production/Stable Unknown Production/Stable Beta Production/Stable Production/Stable Unknown Unknown Beta Production/Stable n/a Production/Stable Unknown Production/Stable Production/Stable Beta Unknown Beta Production/Stable Beta Production/Stable Production/Stable Production/Stable Beta Production/Stable Unknown Production/Stable n/a Beta Production/Stable Beta Unknown Production/Stable Production/Stable Beta Alpha Production/Stable Production/Stable n/a Alpha Production/Stable Production/Stable Production/Stable Beta Beta Unknown n/a Unknown Unknown n/a Unknown Production/Stable Beta Production/Stable Unknown Beta Production/Stable
Last updated Feb. 11, 2021, 10:03 a.m. Jan. 12, 2021, 8:59 a.m. Feb. 17, 2021, 10:53 a.m. Jan. 9, 2020, 8:50 p.m. Feb. 10, 2021, 10:27 a.m. Nov. 13, 2016, 4:24 p.m. Feb. 19, 2021, 6:15 a.m. Dec. 20, 2020, 11:23 a.m. Sept. 28, 2020, 9:34 a.m. July 15, 2020, 2:14 p.m. Feb. 19, 2020, 8:33 p.m. Jan. 19, 2021, 5:58 a.m. Nov. 22, 2020, 11:15 p.m. Dec. 19, 2020, 9:10 a.m. Nov. 19, 2011, 10:16 a.m. Sept. 4, 2018, 1:32 p.m. May 26, 2010, 10:21 a.m. Nov. 20, 2014, 6:11 a.m. Jan. 24, 2018, 12:14 p.m. Feb. 20, 2021, 1:27 p.m. April 3, 2017, 6:22 p.m. July 19, 2019, 6:04 p.m. June 18, 2019, 7:49 a.m. Nov. 12, 2017, 5:19 p.m. April 27, 2020, 4:10 p.m. July 5, 2014, 2:22 p.m. Oct. 21, 2019, 4:42 p.m. Dec. 20, 2018, 7:48 a.m. Feb. 15, 2021, 1:39 p.m. Feb. 25, 2015, 6:23 p.m. Dec. 5, 2019, 8:42 p.m. June 10, 2017, 10:30 p.m. Jan. 10, 2020, 2:14 a.m. Oct. 6, 2011, 1:39 p.m. April 15, 2016, 4:29 p.m. Sept. 14, 2017, 11:44 a.m. Aug. 3, 2020, 7:59 p.m. March 24, 2019, 6:13 a.m. Jan. 27, 2021, 3:49 p.m. Dec. 25, 2017, 3:52 a.m. Jan. 8, 2021, 9:54 a.m. June 11, 2015, 5:31 p.m. Jan. 20, 2014, 9:42 p.m. Oct. 8, 2013, 10:32 a.m. July 3, 2012, 3:27 p.m. March 6, 2018, 4:04 a.m. Oct. 7, 2020, 4:40 a.m. July 2, 2019, 11:24 a.m. May 2, 2020, 3:59 a.m. Oct. 29, 2020, 10:07 a.m. Sept. 9, 2016, 4:58 p.m. April 7, 2016, 5:51 a.m. April 11, 2019, 7:30 a.m. Dec. 5, 2017, 5:28 p.m. Jan. 16, 2021, 5:25 p.m. July 17, 2013, 5:20 p.m. Sept. 1, 2012, 7:49 a.m. Sept. 22, 2020, 4:05 a.m. Oct. 30, 2017, 7:37 p.m. May 7, 2019, 10:30 a.m. Sept. 15, 2017, 9:34 p.m. Oct. 14, 2020, 12:44 p.m. Aug. 27, 2020, 8:48 p.m.
Version3.22.5.01.3.41.1.00.6.40.4.13.11.11.91.0.20.1.51.3.00.23.21.8.10.4.20.2.41.2.1n/a0.50.1.21.1.03.22.0.00.1.40.72.0.50.2.40.2.01.0.01.20.22.0.01.11.6.0n/a1.1.01.0.00.2.00.1.31.5.00.7.10.180.6.00.2.60.3.00.2n/a0.4.02.0.10.6.21.1.00.6.10.4.1.10.0.2n/a1.1.50.0.20n/a0.4.10.1.40.5.10.2.00.1.20.113.2.1
RepoGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubGithubGithubGithub
Commits
Stars6336204211931025655449407404350338226200172166159141140138125116102937365646059514237343029282321212018181717171615151414131211111110888766444
Repo Forks90862223411310020909234884113112061911172164823152117111413258169810564n/a62521n/a3n/a55392511n/a113n/an/a22
Participantsaaugustin
matthiask
robhudson
jdufresne
dcramer
jezdez
tim-schilling
alex
bkonkle
xi
more...
bmihelac
andrewgy8
thauk-copperleaf
manelclos
mgrdcm
jdufresne
rhunwicks
shaggyfrog
jnns
qris
more...
nesdis
jay20162016
lesantana09
Raznak
mishrag
WoLpH
rudolfce
finderseyes
tony13tv
gomesar
more...
sheppard
auvipy
kevinmickey
chrisdev
BertrandBordage
andrlik
fredrikburman
ZuluPro
Parbhat
vtoupet
henhuy
aisipos
sternb0t
more...
agateblue
youtux
Pentusha
radarhere
johnfraney
Mec-iS
waldyrious
yunti
adamchainz
arnau126
MichaelAquilina
graingert
maikroeder
marco-santamaria
pre-commit-ci[bot]
avelis
glogiotatidis
jheld
more...
saxix
int-ua
PetrDlouhy
trepmag
domdinicola
asfaltboy
WoLpH
ticosax
scrck
tdruez
more...
semente
jaap3
morlandi
pconerly
lmorchard
fedosov
kliver
timgates42
artscoop
catmidia
more...
davedash
KevinGrahamFoster
koryd-bixly
maciej-jaworski
pykler
fourk
nektor211
punchagan
andyzickler
ChrFr
more...
sheppard
marianoeramirez
fabiocaccamo
neutrinoceros
martsberger
batisteo
LegoStormtroopr
brad
claudep
s-i-l-k-e
gustavo-sdo
adamchainz
meshy
georgedorn
lilspikey
akaihola
dgouldin
kmike
ionelmc
bacher09
willstott101
georgema1982
bitdeli-chef
mkai
arski
jbaloghhenriquebastos
iurisilvio
martsberger
mauler
ckinseyDmitri-Sintsov
sam-oylov
kiwnix
melvyn-sopacua
gitter-badger
joshourisman
stefanfoulis
acdha
johbo
Chive
beniwohli
akaihola
bradmontgomery
renyi
jazztpt
more...
bradmontgomery
charles-vdulac
smaccona
toastdriven
heyman
phoebebright
remohammadi
mvillarejo
artschwagerb
dmarsh19
more...
nikhila05
ashwin31
itsderek23
zlorf
deschler
tarkatronic
jwilhelm-godaddy
broxeph
kmike
hussaintamboli
bertramr
dumb906trcocblignaut
hedleyroos
JamesJGarner
coady
dependabot[bot]
ionelmc
bitdeli-chef
sheppardvitaliyf
JocelynDelalande
madssj
bedingue
sheppard
achembarpu
tomaszn
realmhamdy
ofalk
marcosox
richleland
justquick
troymelhase
rockymeza
jxcl
nolsto
acatton
julianandrews
sheppardnathan-osman
srogatch
cenkbircanogluW1ldPo1nteremacswayStranger6667
midezz
n1te
priestc
adamcharnock
fish2000
bitdeli-chef
charettes
saippuakauppias
bitdeli-chef
vdboor
jbalogh
andrewdodd
rolimb
denizdoganiheitlager
pyup-bot
MrSeccubus
kakulukia
lowks
zerc
JoeJasinski
dependabot[bot]
Suor
mariacha
ebertti
tomatohater
gitter-badger
robertomoulin
swistakm
MatthewWilkes
yohanboniface
metamatik
diox
grangier
lauxley
nahuelange
chrisdavisgithub
amirouche
ldelcroix
komanaki
agusmakmunartembolazybirdsebpiqmorlandi
jayvdb
bradmontgomeryWoLpHtiagoloureiro
srtab
geoffroy-noel-ddh
jmiguelv
glooney
LegoStormtroopr
Documentation N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Fixtures
Synchronization
Querying
Backup
Import
Used ForImport/ExportFiltering data from querysets without additional DB requestsApproximate Counting, Efficient iteration over large QuerySets, NoSQL lookups with HANDLERImport/Export, backupImport/Export1Generates interactive entity-relationship diagrams from Django models.Export, QueryingQueryingQueryingQuering,
Conditional Aggregations
Import/Export, Data MigrationData synchronization between databasesImport/export; automated synchronization.Export, backupMaking & loading a consistent partial DB dumpDatabase backup managementQueryingImportextensive model changes that need data restructuringIt allows to view data changes on the user-faced Frontend without saving them into the database.Allows you to use Redis datasets similar to how regular database can be managed in the Django Admin. It creates a Redis Queryset by emulating standard Django Querysets.

Within the Admin you see a fake Django Model for every Redis server and/or database. Within those apps you get the regular Model Admin list and edit interfaces.
Obfuscate model fields text data.Reuse standard data vocabularies (Linked data).
Create your own lists.
Improve data input in Django Admin.
Export
Search WeightPackageDescriptionLast PyPI release:Repo ForksStars
{{ item.weight / max_weight * 100 | number:0 }}%{{ item.title }}Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A