Data Tools

Apps, packages, and modules related to data management: import/export, fixtures, serialization and formats, handling large QuerySets, etc.

Features currently being evaluated

FeatureDescription
Fixtures Saving the lists of fixtures then checking which fixtures were already loaded in
unit tests to increase the speed of test development.
Synchronization
Querying Implements query.FilteredRawQuerySet which supersedes Django RawQuerySet with
.filter() / .exclude() / .order_by() and SQL-level slicing.
Backup
Import
Used For How the package relates to data management tasks
Export
Package django-debug-toolbar django-import-export Django REST Pandas djongo django-pandas lifter Django Fixture Magic django-smuggler django-mysql django-adminactions django-batch-select django-spaghetti-and-meatballs django-pivot django-aggregate-if django-queryset-transform django-prefetch django-developer-panel Django Data Wizard django-tablib django-jinja-knockout django-redis-metrics aristotle-metadata-registry django web profiler Tiote Database Management Tool django-synchro django-preferences django-excel-response django-admin-customizer django-dbdump django-feedmapper wq.io Django Natural Keys django-model-values django-separated django-funky-sheets similarityPy vera sqlbuilder django-delegate django-easydump XDump Export data to file (with select fields) data-migrator django-queryset-decorator requery django-archive Django Light Draft django-carrier-pigeon datapurge Django Nsync django-undeletable django-dumbo any2any djipsum django-janitor Django Redis Admin Django Obfuscate
Package django-debug-toolbar django-import-export Django REST Pandas djongo django-pandas lifter Django Fixture Magic django-smuggler django-mysql django-adminactions django-batch-select django-spaghetti-and-meatballs django-pivot django-aggregate-if django-queryset-transform django-prefetch django-developer-panel Django Data Wizard django-tablib django-jinja-knockout django-redis-metrics aristotle-metadata-registry django web profiler Tiote Database Management Tool django-synchro django-preferences django-excel-response django-admin-customizer django-dbdump django-feedmapper wq.io Django Natural Keys django-model-values django-separated django-funky-sheets similarityPy vera sqlbuilder django-delegate django-easydump XDump Export data to file (with select fields) data-migrator django-queryset-decorator requery django-archive Django Light Draft django-carrier-pigeon datapurge Django Nsync django-undeletable django-dumbo any2any djipsum django-janitor Django Redis Admin Django Obfuscate
Description A configurable set of panels
that display various debug
information about the current
request/response.
Django application and library
for importing and exporting
data with admin integration.
📊📈 Serves up Pandas dataframes
via the Django REST Framework
for use in client-side (i.e.
d3.js) visualizations and
offline analysis ...
Django and MongoDB database
connector
Tools for working with pandas
in your Django projects
A generic query engine,
inspired by Django ORM
Utilities to extract and
manipulate Django Fixtures.
Django Smuggler is a pluggable
application for Django Web
Framework that helps you to
import/export fixtures via the
automatically-generated
administration ...
:dolphin: :horse: Extensions
to Django for use with
MySQL/MariaDB
collection of useful django
actions to use with ModelAdmin
or AdminSi...
batch select many-to-many and
one-to-many fields (to help
avoid n+1 query problem)
Its a spicy meatball for
serving up fresh hot
entity-relationship diagrams
straight from your django
models.
A module for pivoting Django
Querysets
Conditional aggregates for
Django queries, just like the
famous SumIf and CountIf in
Excel.
Experimental .transform(fn)
method for Django QuerySets,
for clever lazily evaluated
optimisations.
Generic model related data
prefetch framework for Django.
Debug Django applications
directly in Google Chrome
Devtools.
🧙⚙️ Import structured data
(e.g. Excel, CSV, XML, JSON)
into one or more Django models
via an interactive web-based
wizard
django-tablib is a helper
library for Django that allows
Django models to be used to
generate tablib datasets with
introspection ...
Django datatables and widgets,
both AJAX and traditional.
Display-only ModelForms.
ModelForms / inline formsets
with AJAX submit and
validation. Works ...
Metrics for django apps backed
by Redis.
Aristotle-MDR is an
open-source metadata registry
as laid out by the
requirements of the ISO/IEC
11179 specification.
Django package to log request
values such as device, IP
address, user CPU time, system
CPU time, No of queries, ...
django database management Django app for database data
synchronization.
Django app allowing users to
set app specific preferences
through the admin interfa...
Django package to easily
render Excel spreadsheets
Django admin customizing
interface
Django management command to
run mysqldump or pg_dump
A utility for mapping feeds to
Django models.
⇔ wq's io library, an
interoperability tool for
importing and exporting
tabular and time series data,
e.g. from citizen science, ...
Enhanced support for natural
keys in Django and Django REST
Framework.
Taking the O out of ORM. Class-based view and mixins
for handling CSV with Django.
Django implementation of
Handsontable spreadsheets for
CRUD actions
Distance Algorithms 📑⚙️ Python/Django reference
implementation of the ERAV
data model
Lightweight Python SQLBuilder.
Can be integrated with Django.
Automatic delegate methods for
Django managers and querysets
without runtime dispatch
penalties.
Easily load database snapshots
across deployments
A consistent partial database
copy & load utility
Export model data (with
selected fields) to csv file
A declarative data-migration
package
A .decorate(fn) method for
Django QuerySets, for clever
lazily evaluated expressions.
Store e run queries on
database to help system
manager of a Django website
Management command for
creating compressed archives
of Django projects, including
database tables and uploaded
media.
Preview changes without saving
the data into db
Export module that catch
modified objects and push them
via some methods (FTP...)
Simple Django app for managing
data retention.
A simple way to keep your
Django Model data 'n-sync with
N external systems.
undeletable Django models Dumps and loads both the
database and the media files.
NOW MOVED TO :
https://github.com/sebpiq/any2any
:pencil: Django Lorem Ipsum
Generator - Command plugin to
generate (fake content data)
for Django
django-janitor allows you to
use bleach to clean HTML
stored in a Model's field.
A Django Admin interface for
Redis servers with optional
Redis Sentinel support
Django app to obfuscate text
data.
CategoryAppAppAppOtherAppAppAppAppAppAppAppAppAppOtherAppOtherOtherAppAppFrameworkAppFrameworkAppAppAppAppAppAppAppAppOtherOtherOtherOtherAppAppAppAppAppAppOtherAppOtherOtherAppAppAppAppAppAppAppAppOtherAppAppAppApp
# Using This5121914541261221111203111100102010110101122014011102111131200
Python 3?
Development Status Production/Stable Unknown Production/Stable Alpha Alpha Pre-Alpha Beta Production/Stable Production/Stable Unknown Beta Unknown Unknown Production/Stable n/a Production/Stable Unknown Production/Stable Production/Stable Beta Beta Production/Stable Unknown Beta Beta Production/Stable Production/Stable Beta Unknown n/a Production/Stable Production/Stable Production/Stable Beta Production/Stable Unknown Production/Stable Production/Stable Production/Stable Alpha Beta Production/Stable Production/Stable n/a Beta Beta Beta n/a Unknown Alpha Production/Stable n/a Unknown Unknown Beta Production/Stable Unknown
Last updated July 9, 2019, 11:14 a.m. July 2, 2019, 4:15 a.m. March 27, 2019, 11:39 p.m. June 22, 2019, 4:31 p.m. March 28, 2019, 9:45 a.m. Nov. 13, 2016, 4:24 p.m. June 11, 2019, 4:50 p.m. Nov. 5, 2018, 10:54 a.m. July 6, 2019, 9:55 a.m. April 13, 2019, 2:05 p.m. Nov. 19, 2011, 10:16 a.m. Jan. 19, 2019, 6:28 p.m. July 3, 2019, 9:27 a.m. Nov. 20, 2014, 6:11 a.m. May 26, 2010, 10:21 a.m. Sept. 4, 2018, 1:32 p.m. Jan. 24, 2018, 12:14 p.m. July 4, 2019, 10:43 p.m. April 3, 2017, 6:22 p.m. July 10, 2019, 10:38 a.m. Feb. 6, 2017, 1:50 p.m. July 14, 2019, 6:28 p.m. June 18, 2019, 7:49 a.m. July 5, 2014, 2:22 p.m. Nov. 12, 2017, 5:19 p.m. Dec. 20, 2018, 7:48 a.m. March 28, 2018, 3:30 p.m. Feb. 25, 2015, 6:23 p.m. June 10, 2017, 10:30 p.m. Oct. 6, 2011, 1:39 p.m. June 12, 2018, 3:16 p.m. March 1, 2019, 12:41 a.m. July 13, 2019, 2:55 p.m. April 15, 2016, 4:29 p.m. May 28, 2019, 1:54 p.m. March 24, 2019, 6:13 a.m. Sept. 14, 2017, 11:44 a.m. Dec. 25, 2017, 3:52 a.m. Jan. 20, 2014, 9:42 p.m. June 11, 2015, 5:31 p.m. Aug. 11, 2018, 9:16 a.m. Oct. 8, 2013, 10:32 a.m. July 2, 2019, 11:24 a.m. July 3, 2012, 3:27 p.m. Sept. 9, 2016, 4:58 p.m. June 1, 2019, 10:17 p.m. July 15, 2018, 7:21 a.m. April 11, 2019, 7:30 a.m. April 7, 2016, 5:51 a.m. March 6, 2018, 4:04 a.m. Feb. 17, 2019, 7:14 a.m. July 17, 2013, 5:20 p.m. Sept. 1, 2012, 7:49 a.m. Dec. 5, 2017, 5:28 p.m. Oct. 30, 2017, 7:37 p.m. May 7, 2019, 10:30 a.m. Sept. 15, 2017, 9:34 p.m.
Version2.01.2.01.1.01.2.330.6.10.4.10.1.40.9.13.2.01.6.00.2.40.2.21.8.00.5n/a1.2.10.1.21.1.03.20.8.21.6.02.2.00.1.40.2.40.71.0.02.0.30.21.1n/a1.1.01.4.01.01.1.00.1.30.1.31.0.00.7.10.180.3.00.2.60.6.00.20.6.2n/a0.4.1.10.1.60.6.0n/a0.0.20.4.01.1.0n/a0.4.11.1.50.5.10.2.00.1.2
RepoGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubGithub
Commits
Stars5501154983461453144728628327025716214214113913513512211310091876861605747413731282725242219181818171716161313121110101099987644
Repo Forks840493861268619792866796177161117n/a214612225491121119514878n/a10344624125n/a9425125n/a113n/an/a
Participantsaaugustin
robhudson
dcramer
matthiask
jezdez
jdufresne
tim-schilling
alex
idan
bkonkle
more...
bmihelac
thauk-copperleaf
andrewgy8
manelclos
jdufresne
mgrdcm
rhunwicks
shaggyfrog
jnns
qris
more...
sheppard
auvipy
kevinmickey
nesdis
Raznak
WoLpH
rudolfce
finderseyes
gomesar
M1kEk1M
sshishov
tbobm
tony
more...
chrisdev
BertrandBordage
andrlik
coachhippo
ZuluPro
Parbhat
vtoupet
henhuy
sternb0t
kgabbott
more...
EliotBerriot
Ogreman
youtux
Pentusha
radarhere
johnfraney
Mec-iS
waldyrious
davedash
KevinGrahamFoster
koryd-bixly
maciej-jaworski
pykler
fourk
punchagan
andyzickler
ChrFr
miigotu
more...
semente
jaap3
morlandi
pconerly
lmorchard
fedosov
kliver
artscoop
catmidia
lachie
adamchainz
arnau126
MichaelAquilina
graingert
maikroeder
marco-santamaria
avelis
glogiotatidis
kjam
flanaman
more...
saxix
int-ua
PetrDlouhy
trepmag
asfaltboy
WoLpH
ticosax
scrck
tdruez
rvoicilas
more...
lilspikey
akaihola
dgouldin
kmike
LegoStormtroopr
brad
claudep
gustavo-sdo
adamchainz
meshy
zkan
martsberger
batisteo
henriquebastos
iurisilvio
martsberger
mauler
jbaloghionelmc
bacher09
willstott101
georgema1982
bitdeli-chef
mkai
arski
ckinseysheppardjoshourisman
stefanfoulis
acdha
johbo
Chive
beniwohli
akaihola
bradmontgomery
renyi
jazztpt
more...
Dmitri-Sintsov
sam-oylov
melvyn-sopacua
gitter-badger
bradmontgomery
charles-vdulac
smaccona
toastdriven
heyman
phoebebright
remohammadi
mvillarejo
artschwagerb
sttts
more...
harrywhite4
LegoStormtroopr
s-i-l-k-e
fragalcer
tagpro
thsutton
larrn
jadedjester
itepifanio
borsna
more...
nikhila05
ashwin31
itsderek23
dumb906zlorf
deschler
cblignaut
hedleyroos
JamesJGarner
tarkatronic
kmike
hussaintamboli
bertramr
ionelmc
bitdeli-chef
vitaliyf
JocelynDelalande
madssj
bedingue
richleland
justquick
troymelhase
sheppardsheppard
arvindch
tomaszn
realmhamdy
ofalk
marcosox
coadyrockymeza
jxcl
nolsto
acatton
julianandrews
trcocenkbircanoglusheppardemacswayfish2000
bitdeli-chef
charettes
priestc
adamcharnock
Stranger6667
n1te
saippuakauppias
bitdeli-chef
iheitlager
pyup-bot
MrSeccubus
vdboor
jbalogh
ebertti
tomatohater
gitter-badger
robertomoulin
nathan-osman
srogatch
zerc
JoeJasinski
Suor
mariacha
yohanboniface
metamatik
grangier
diox
lauxley
nahuelange
chrisdavisgithub
amirouche
ldelcroix
komanaki
swistakm
MatthewWilkes
andrewdodd
rolimb
kakulukia
lowks
lazybirdsebpiqagusmakmunbradmontgomeryWoLpHtiagoloureiro
srtab
Documentation N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Fixtures
Synchronization
Querying
Backup
Import
Used ForImport/ExportFiltering data from querysets without additional DB requestsImport/Export1Import/Export, backupApproximate Counting, Efficient iteration over large QuerySets, NoSQL lookups with HANDLERExport, QueryingGenerates interactive entity-relationship diagrams from Django models.Quering,
Conditional Aggregations
QueryingQueryingImport/Export, Data MigrationData synchronization between databasesImport/export; automated synchronization.Database backup managementMaking & loading a consistent partial DB dumpextensive model changes that need data restructuringQueryingExport, backupIt allows to view data changes on the user-faced Frontend without saving them into the database.ImportAllows you to use Redis datasets similar to how regular database can be managed in the Django Admin. It creates a Redis Queryset by emulating standard Django Querysets.

Within the Admin you see a fake Django Model for every Redis server and/or database. Within those apps you get the regular Model Admin list and edit interfaces.
Obfuscate model fields text data.
Export
Search WeightPackageDescriptionLast PyPI release:Repo ForksStars
{{ item.weight / max_weight * 100 | number:0 }}%{{ item.title }}Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A