Data Tools

Apps, packages, and modules related to data management: import/export, fixtures, serialization and formats, handling large QuerySets, etc.

Features currently being evaluated

FeatureDescription
Fixtures Saving the lists of fixtures then checking which fixtures were already loaded in
unit tests to increase the speed of test development.
Synchronization
Querying Implements query.FilteredRawQuerySet which supersedes Django RawQuerySet with
.filter() / .exclude() / .order_by() and SQL-level slicing.
Backup
Import
Used For How the package relates to data management tasks
Export
Package django-debug-toolbar django-import-export Django REST Pandas django-pandas lifter djongo django-smuggler Django Fixture Magic django-mysql django-adminactions django-batch-select django-aggregate-if django-queryset-transform django-spaghetti-and-meatballs django-prefetch django-developer-panel django-tablib Django Data Wizard django-redis-metrics django-jinja-knockout aristotle-metadata-registry Tiote Database Management Tool django-synchro django web profiler django-pivot django-admin-customizer django-excel-response django-dbdump django-feedmapper wq.io django-model-values django-separated Django Natural Keys sqlbuilder similarityPy vera django-easydump django-delegate Export data to file (with select fields) XDump django-queryset-decorator data-migrator requery datapurge django-carrier-pigeon django-archive django-dumbo Django Light Draft Django Nsync any2any django-undeletable djipsum django-janitor Django Obfuscate
Package django-debug-toolbar django-import-export Django REST Pandas django-pandas lifter djongo django-smuggler Django Fixture Magic django-mysql django-adminactions django-batch-select django-aggregate-if django-queryset-transform django-spaghetti-and-meatballs django-prefetch django-developer-panel django-tablib Django Data Wizard django-redis-metrics django-jinja-knockout aristotle-metadata-registry Tiote Database Management Tool django-synchro django web profiler django-pivot django-admin-customizer django-excel-response django-dbdump django-feedmapper wq.io django-model-values django-separated Django Natural Keys sqlbuilder similarityPy vera django-easydump django-delegate Export data to file (with select fields) XDump django-queryset-decorator data-migrator requery datapurge django-carrier-pigeon django-archive django-dumbo Django Light Draft Django Nsync any2any django-undeletable djipsum django-janitor Django Obfuscate
Description A configurable set of panels
that display various debug
information about the current
request/response.
Django application and library
for importing and exporting
data with admin integration.
📊📈 Serves up Pandas dataframes
via the Django REST Framework
for use in client-side (i.e.
d3.js) visualizations and
offline analysis ...
Tools for working with pandas
in your Django projects
A generic query engine,
inspired by Django ORM
Django and MongoDB database
connector
Django Smuggler is a pluggable
application for Django Web
Framework that helps you to
import/export fixtures via the
automatically-generated
administration ...
Utilities to extract and
manipulate Django Fixtures.
:dolphin: :horse: Extensions
to Django for use with
MySQL/MariaDB
collection of useful django
actions to use with ModelAdmin
or AdminSi...
batch select many-to-many and
one-to-many fields (to help
avoid n+1 query problem)
Conditional aggregates for
Django queries, just like the
famous SumIf and CountIf in
Excel.
Experimental .transform(fn)
method for Django QuerySets,
for clever lazily evaluated
optimisations.
Its a spicy meatball for
serving up fresh hot
entity-relationship diagrams
straight from your django
models.
Generic model related data
prefetch framework for Django.
Debug Django applications
directly in Google Chrome
Devtools.
django-tablib is a helper
library for Django that allows
Django models to be used to
generate tablib datasets with
introspection ...
🔮⚙️ Import structured data
(e.g. Excel, CSV, XML, JSON)
into one or more Django models
via an interactive web-based
wizard
Metrics for django apps backed
by Redis.
Django datatables and widgets,
both AJAX and traditional.
Display-only ModelForms.
ModelForms / inline formsets
with AJAX submit and
validation. Works ...
Aristotle-MDR is an
open-source metadata registry
as laid out by the
requirements of the ISO/IEC
11179 specification.
django database management Django app for database data
synchronization.
Micropyramid develops an open
source Django package which
helps to optimize the
performance of your Django
application. Django web
profiler ...
A module for pivoting Django
Querysets
Django admin customizing
interface
Django package to easily
render Excel spreadsheets
Django management command to
run mysqldump or pg_dump
A utility for mapping feeds to
Django models.
⇔ wq's io library, an
interoperability tool for
importing and exporting
tabular and time series data,
e.g. from citizen science, ...
Taking the O out of ORM. Class-based view and mixins
for handling CSV with Django.
Enhanced support for natural
keys in Django and Django REST
Framework.
Lightweight Python SQLBuilder.
Can be integrated with Django.
Distance Algorithms 📑⚙️ Python/Django reference
implementation of the ERAV
data model
Easily load database snapshots
across deployments
Automatic delegate methods for
Django managers and querysets
without runtime dispatch
penalties.
Export model data (with
selected fields) to csv file
A consistent partial database
copy & load utility
A .decorate(fn) method for
Django QuerySets, for clever
lazily evaluated expressions.
A declarative data-migration
package
Store e run queries on
database to help system
manager of a Django website
Simple Django app for managing
data retention.
Export module that catch
modified objects and push them
via some methods (FTP...)
Management command for
creating compressed archives
of Django projects, including
database tables and uploaded
media.
Dumps and loads both the
database and the media files.
Preview changes without saving
the data into db
A simple way to keep your
Django Model data 'n-sync with
N external systems.
NOW MOVED TO :
https://github.com/sebpiq/any2any
undeletable Django models :pencil: Django Lorem Ipsum
Generator - Command plugin to
generate (fake content data)
for Django
django-janitor allows you to
use bleach to clean HTML
stored in a Model's field.
Django app to obfuscate text
data.
CategoryAppAppAppAppAppOtherAppAppAppAppAppOtherAppAppOtherOtherAppAppAppFrameworkFrameworkAppAppAppAppAppAppAppAppOtherOtherOtherOtherAppAppAppAppAppAppOtherOtherOtherAppAppAppAppAppAppAppOtherAppAppAppApp
# Using This5081712412421221112013111010102101011211024110112110131120
Python 3?
Development Status Production/Stable Unknown Production/Stable Alpha Pre-Alpha Alpha Production/Stable Beta Production/Stable Unknown Beta Production/Stable n/a Unknown Production/Stable Unknown Production/Stable Production/Stable Beta Beta Production/Stable Beta Beta Unknown Unknown Beta Production/Stable Unknown n/a Production/Stable Production/Stable Beta Production/Stable Production/Stable Unknown Production/Stable Alpha Production/Stable Production/Stable Beta n/a Production/Stable Beta Unknown n/a Beta n/a Beta Alpha Unknown Production/Stable Unknown Beta Unknown
Last updated Nov. 7, 2018, 9:13 a.m. Nov. 5, 2018, 3:08 a.m. Sept. 13, 2017, 1:52 p.m. April 3, 2018, 1:37 p.m. Nov. 13, 2016, 4:24 p.m. Nov. 10, 2018, 10:54 a.m. Nov. 5, 2018, 10:54 a.m. Oct. 6, 2018, 1:06 p.m. Nov. 10, 2018, 7:51 a.m. April 18, 2018, 2:06 p.m. Nov. 19, 2011, 10:16 a.m. Nov. 20, 2014, 6:11 a.m. May 26, 2010, 10:21 a.m. Oct. 28, 2018, 7:09 p.m. Sept. 4, 2018, 1:32 p.m. Jan. 24, 2018, 12:14 p.m. April 3, 2017, 6:22 p.m. Sept. 12, 2017, 4:30 p.m. Feb. 6, 2017, 1:50 p.m. Nov. 11, 2018, 2:05 p.m. Nov. 12, 2018, 5:20 p.m. July 5, 2014, 2:22 p.m. Nov. 12, 2017, 5:19 p.m. March 5, 2018, 8:03 a.m. Nov. 3, 2018, 9:16 p.m. Feb. 25, 2015, 6:23 p.m. March 28, 2018, 3:30 p.m. June 10, 2017, 10:30 p.m. Oct. 6, 2011, 1:39 p.m. June 12, 2018, 3:16 p.m. Aug. 1, 2018, 8:13 p.m. April 15, 2016, 4:29 p.m. April 12, 2018, 12:38 p.m. Dec. 25, 2017, 3:52 a.m. Jan. 25, 2015, 3:51 a.m. Sept. 14, 2017, 11:44 a.m. June 11, 2015, 5:31 p.m. Jan. 20, 2014, 9:42 p.m. Oct. 8, 2013, 10:32 a.m. Aug. 11, 2018, 9:16 a.m. July 3, 2012, 3:27 p.m. Nov. 3, 2018, 3:42 p.m. Sept. 9, 2016, 4:58 p.m. April 7, 2016, 5:51 a.m. Feb. 2, 2017, 6:01 a.m. Jan. 5, 2015, 11:52 p.m. July 17, 2013, 5:20 p.m. July 15, 2018, 7:21 a.m. March 6, 2018, 4:04 a.m. Sept. 1, 2012, 7:49 a.m. Feb. 23, 2018, 10:20 a.m. Dec. 5, 2017, 5:28 p.m. Oct. 30, 2017, 7:37 p.m. Sept. 15, 2017, 9:34 p.m.
Version1.10.11.1.01.0.00.5.10.4.11.2.300.9.10.1.42.4.11.50.2.40.5n/a0.2.21.2.10.1.23.21.0.11.6.00.7.12.2.00.2.40.70.1.41.6.10.22.0.31.1n/a1.1.00.61.1.01.4.00.7.10.180.1.31.0.00.2.60.3.00.20.6.0n/a0.6.20.3.5.10.0.2n/a0.1.5n/a0.6.00.4.00.4.11.0.01.1.50.5.10.1.2
RepoGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubGithub
Commits
Stars50961335724448446381266263228216161135135134129110100838270606056464038343028232019191818171716151312111110101099888664
Repo Forks8054477681198025796274815111416n/a451718451112172571487n/a1075334221n/a59142n/a2214n/a3n/a
Participantsaaugustin
robhudson
dcramer
jezdez
matthiask
tim-schilling
jdufresne
alex
idan
bkonkle
more...
bmihelac
thauk-copperleaf
manelclos
mgrdcm
rhunwicks
jdufresne
shaggyfrog
jnns
qris
geeknam
more...
sheppard
auvipy
kevinmickey
chrisdev
BertrandBordage
andrlik
coachhippo
Parbhat
henhuy
kgabbott
sternb0t
rda-dev
meiralins
more...
EliotBerriot
Ogreman
youtux
Pentusha
radarhere
johnfraney
Mec-iS
waldyrious
yunti
nesdis
WoLpH
rudolfce
M1kEk1M
Raznak
sshishov
tbobm
finderseyes
ravinarayansingh
ccravens
more...
semente
jaap3
morlandi
pconerly
lmorchard
fedosov
kliver
Osmose
artscoop
catmidia
more...
davedash
KevinGrahamFoster
koryd-bixly
maciej-jaworski
pykler
fourk
punchagan
andyzickler
ChrFr
miigotu
more...
adamchainz
arnau126
MichaelAquilina
graingert
maikroeder
marco-santamaria
avelis
glogiotatidis
kjam
flanaman
more...
saxix
int-ua
trepmag
ticosax
asfaltboy
PetrDlouhy
tdruez
scrck
rvoicilas
axsapronov
more...
lilspikey
akaihola
dgouldin
kmike
henriquebastos
iurisilvio
martsberger
mauler
jbaloghLegoStormtroopr
brad
claudep
Gustavosdo
adamchainz
zkan
ionelmc
bacher09
willstott101
georgema1982
bitdeli-chef
mkai
arski
ckinseyjoshourisman
stefanfoulis
acdha
johbo
Chive
beniwohli
akaihola
bradmontgomery
renyi
jazztpt
more...
sheppardbradmontgomery
charles-vdulac
smaccona
toastdriven
heyman
phoebebright
remohammadi
mvillarejo
artschwagerb
sttts
more...
Dmitri-Sintsov
sam-oylov
melvyn-sopacua
gitter-badger
LegoStormtroopr
harrywhite4
thsutton
larrn
jadedjester
itepifanio
borsna
DeKaN
derrix060
mpomery
more...
dumb906zlorf
deschler
nikhila05
ashwin31
itsderek23
martsbergerionelmc
bitdeli-chef
tarkatronic
kmike
hussaintamboli
bertramr
vitaliyf
JocelynDelalande
madssj
bedingue
richleland
justquick
troymelhase
sheppardcoady
invalid-email-address
rockymeza
jxcl
nolsto
acatton
julianandrews
sheppard
tomaszn
ofalk
emacswaycenkbircanoglusheppardpriestc
adamcharnock
fish2000
bitdeli-chef
charettes
saippuakauppias
bitdeli-chef
Stranger6667
n1te
vdboor
jbalogh
iheitlager
pyup-bot
seccubus
ebertti
tomatohater
gitter-badger
robertomoulin
swistakm
MatthewWilkes
yohanboniface
metamatik
nahuelange
grangier
diox
lauxley
chrisdavisgithub
amirouche
nathan-osmanlazybirdzerc
JoeJasinski
Suor
mariacha
andrewdodd
rolimb
sebpiqkakulukia
lowks
agusmakmunbradmontgomerytiagoloureiro
srtab
Documentation N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Fixtures
Synchronization
Querying
Backup
Import
Used ForImport/ExportFiltering data from querysets without additional DB requestsImport/Export, backupImport/Export1Approximate Counting, Efficient iteration over large QuerySets, NoSQL lookups with HANDLERExport, QueryingQuering,
Conditional Aggregations
QueryingGenerates interactive entity-relationship diagrams from Django models.QueryingImport/Export, Data MigrationData synchronization between databasesImport/export; automated synchronization.Database backup managementMaking & loading a consistent partial DB dumpQueryingextensive model changes that need data restructuringExport, backupIt allows to view data changes on the user-faced Frontend without saving them into the database.ImportObfuscate model fields text data.
Export
Search WeightPackageDescriptionLast PyPI release:Repo ForksStars
{{ item.weight / max_weight * 100 | number:0 }}%{{ item.title }}Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A