Data Tools

Apps, packages, and modules related to data management: import/export, fixtures, serialization and formats, handling large QuerySets, etc.

Features currently being evaluated

FeatureDescription
Fixtures Saving the lists of fixtures then checking which fixtures were already loaded
allows to execute Selenium tests partially, increasing the speed of test
development.
Synchronization
Querying Implements FilteredRawQuerySet which supersedes Django RawQuerySet with
.filter() / .exclude() / .order_by() and SQL-level slicing.
Implements ListQuerySet for Python lists, including prefetched reverse
relationships.
Backup
Import
Export
Used For FilteredRawQuerySet allows to use raw SELECT for Django paginator.
ListQuerySet allows to use Python lists (including prefetched reverse
relationships) in Django ORM calls and for Django paginator.
Package django-debug-toolbar django-import-export djongo Django REST Pandas django-pandas django-adminactions lifter django-mysql django-smuggler Django Fixture Magic python-benedict Django Data Wizard django-spaghetti-and-meatballs django-pivot django-batch-select django-prefetch django-queryset-transform django-aggregate-if django-developer-panel django-jinja-knockout django-tablib django-redis-metrics django web profiler django-excel-response django-synchro django-funky-sheets Tiote Database Management Tool django-preferences django-model-values django-admin-customizer IterTable django-dbdump Django Natural Keys django-feedmapper django-queryable-properties django-archive django-separated vera similarityPy sqlbuilder django-easydump django-delegate XDump Export data to file (with select fields) data-migrator Django Nsync django-queryset-decorator Django Debug Requests & Responses (DDRR) django-undeletable datapurge Django Tarantool requery django-carrier-pigeon Django Light Draft djipsum django-dumbo any2any django-tables-cleaner Django Redis Admin django-janitor frePPLe data admin aristotle-metadata-registry Django Controlled Vocabulary django-crypto-extensions Django Obfuscate djangophysics
Package django-debug-toolbar django-import-export djongo Django REST Pandas django-pandas django-adminactions lifter django-mysql django-smuggler Django Fixture Magic python-benedict Django Data Wizard django-spaghetti-and-meatballs django-pivot django-batch-select django-prefetch django-queryset-transform django-aggregate-if django-developer-panel django-jinja-knockout django-tablib django-redis-metrics django web profiler django-excel-response django-synchro django-funky-sheets Tiote Database Management Tool django-preferences django-model-values django-admin-customizer IterTable django-dbdump Django Natural Keys django-feedmapper django-queryable-properties django-archive django-separated vera similarityPy sqlbuilder django-easydump django-delegate XDump Export data to file (with select fields) data-migrator Django Nsync django-queryset-decorator Django Debug Requests & Responses (DDRR) django-undeletable datapurge Django Tarantool requery django-carrier-pigeon Django Light Draft djipsum django-dumbo any2any django-tables-cleaner Django Redis Admin django-janitor frePPLe data admin aristotle-metadata-registry Django Controlled Vocabulary django-crypto-extensions Django Obfuscate djangophysics
Description A configurable set of panels
that display various debug
information about the current
request/response.
Django application and library
for importing and exporting
data with admin integration.
Django and MongoDB database
connector
📊📈 Serves up Pandas dataframes
via the Django REST Framework
for use in client-side (i.e.
d3.js) visualizations and
offline analysis ...
Tools for working with pandas
in your Django projects
collection of useful django
actions to use with ModelAdmin
or AdminSi...
A generic query engine,
inspired by Django ORM
:dolphin: :horse: Extensions
to Django for use with
MySQL/MariaDB
Django Smuggler is a pluggable
application for Django Web
Framework that helps you to
import/export fixtures via the
automatically-generated
administration ...
Utilities to extract and
manipulate Django Fixtures.
dict subclass with
keylist/keypath support,
normalized I/O operations
(base64, csv, ini, json,
pickle, plist, query-string,
toml, xml, yaml) and many ...
🧙⚙️ Import structured data
(e.g. Excel, CSV, XML, JSON)
into one or more Django models
via an interactive web-based
wizard
Its a spicy meatball for
serving up fresh hot
entity-relationship diagrams
straight from your django
models.
A module for pivoting Django
Querysets
batch select many-to-many and
one-to-many fields (to help
avoid n+1 query problem)
Generic model related data
prefetch framework for Django.
Experimental .transform(fn)
method for Django QuerySets,
for clever lazily evaluated
optimisations.
Conditional aggregates for
Django queries, just like the
famous SumIf and CountIf in
Excel.
Debug Django applications
directly in Google Chrome
Devtools.
Django datatables and widgets,
both AJAX and traditional.
Display-only ModelForms.
ModelForms / inline formsets
with AJAX submit and
validation. Works ...
django-tablib is a helper
library for Django that allows
Django models to be used to
generate tablib datasets with
introspection ...
Metrics for django apps backed
by Redis.
Django package to log request
values such as device, IP
address, user CPU time, system
CPU time, No of queries, ...
Django package to easily
render Excel spreadsheets
Django app for database data
synchronization.
Django implementation of
Handsontable spreadsheets for
CRUD actions.
django database management Django app allowing users to
set app specific preferences
through the admin interfa...
Taking the O out of ORM. Django admin customizing
interface
⇔ IterTable is a Pythonic API
for iterating through tabular
data formats, including CSV,
XLS, XML, and JSON.
Django management command to
run mysqldump or pg_dump
Enhanced support for natural
keys in Django and Django REST
Framework.
A utility for mapping feeds to
Django models.
Write Django model properties
that can be used in database
queries.
Management command for
creating compressed archives
of Django projects, including
database tables and uploaded
media.
Class-based view and mixins
for handling CSV with Django.
📑⚙️ Python/Django reference
implementation of the ERAV
data model
Distance Algorithms Lightweight Python SQLBuilder.
Can be integrated with Django.
Easily load database snapshots
across deployments
Automatic delegate methods for
Django managers and querysets
without runtime dispatch
penalties.
A consistent partial database
copy & load utility
Export model data (with
selected fields) to csv file
A declarative data-migration
package
A simple way to keep your
Django Model data 'n-sync with
N external systems.
A .decorate(fn) method for
Django QuerySets, for clever
lazily evaluated expressions.
Print request and response
headers, body (with
pretty-printing), etc.
undeletable Django models Simple Django app for managing
data retention.
Tarantool database backend for
Django applications.
https://www.tarantool.io
Store e run queries on
database to help system
manager of a Django website
Export module that catch
modified objects and push them
via some methods (FTP...)
Preview changes without saving
the data into the database
:pencil: Django lorem ipsum
generator - command plugin to
generate (fake content data)
for django
Dumps and loads both the
database and the media files.
NOW MOVED TO :
https://github.com/sebpiq/any2any
A Django app used to remove
oldest records from specific
db tables
A Django Admin interface for
Redis servers with optional
Redis Sentinel support
django-janitor allows you to
use bleach to clean HTML
stored in a Model's field.
A django-based framework for
rapid development of
enterprise data applications.
A Django application to link
your data to standard
vocabularies or your own
controlled lists.
Django app to obfuscate text
data.
Quantities, currencies and
physics Django APIs
CategoryAppAppOtherAppAppAppAppAppAppAppOtherAppAppAppAppOtherAppOtherOtherFrameworkAppAppAppAppAppAppAppAppOtherAppOtherAppOtherAppOtherAppOtherAppAppAppAppAppOtherAppOtherAppOtherAppAppAppAppAppAppAppAppAppOtherAppAppAppFrameworkFrameworkAppAppAppFramework
# Using This5302361942116205112211011102100000111001111202140111010120113002010000
Python 3?
Development Status Production/Stable Unknown Alpha Production/Stable Alpha Unknown Pre-Alpha Production/Stable Production/Stable Beta Production/Stable Production/Stable Unknown Unknown Beta Production/Stable n/a Production/Stable Unknown Production/Stable Production/Stable Beta Unknown Production/Stable Beta Production/Stable Beta Production/Stable Production/Stable Beta Production/Stable Unknown Production/Stable n/a Production/Stable Beta Beta Production/Stable Unknown Production/Stable Alpha Production/Stable Beta Production/Stable Production/Stable Alpha n/a Production/Stable Production/Stable Unknown Unknown Beta n/a Beta Unknown n/a Unknown Production/Stable Production/Stable Beta Unknown Production/Stable Beta Unknown Unknown Beta
Last updated July 20, 2021, 4:47 p.m. July 12, 2021, 4:16 a.m. July 20, 2021, 11:26 a.m. Jan. 9, 2020, 8:50 p.m. July 6, 2021, 2:19 p.m. July 15, 2021, 4:51 a.m. Nov. 13, 2016, 4:24 p.m. July 20, 2021, 4:58 a.m. Sept. 28, 2020, 9:34 a.m. March 12, 2021, 12:02 a.m. May 4, 2021, 5:43 p.m. Feb. 19, 2020, 8:33 p.m. Dec. 19, 2020, 9:10 a.m. Nov. 22, 2020, 11:15 p.m. Nov. 19, 2011, 10:16 a.m. June 1, 2021, 2:16 p.m. May 26, 2010, 10:21 a.m. Nov. 20, 2014, 6:11 a.m. Jan. 24, 2018, 12:14 p.m. July 12, 2021, 6:27 a.m. April 3, 2017, 6:22 p.m. July 19, 2019, 6:04 p.m. June 18, 2019, 7:49 a.m. April 27, 2020, 4:10 p.m. Nov. 12, 2017, 5:19 p.m. March 14, 2021, 7:25 a.m. July 5, 2014, 2:22 p.m. Dec. 20, 2018, 7:48 a.m. July 19, 2021, 8:32 p.m. Feb. 25, 2015, 6:23 p.m. Dec. 5, 2019, 8:42 p.m. June 10, 2017, 10:30 p.m. Jan. 10, 2020, 2:14 a.m. Oct. 6, 2011, 1:39 p.m. July 15, 2021, 8:05 a.m. Aug. 3, 2020, 7:59 p.m. April 15, 2016, 4:29 p.m. Sept. 14, 2017, 11:44 a.m. March 24, 2019, 6:13 a.m. Dec. 25, 2017, 3:52 a.m. June 11, 2015, 5:31 p.m. Jan. 20, 2014, 9:42 p.m. Jan. 8, 2021, 9:54 a.m. Oct. 8, 2013, 10:32 a.m. July 2, 2019, 11:24 a.m. March 6, 2018, 4:04 a.m. July 3, 2012, 3:27 p.m. Oct. 7, 2020, 4:40 a.m. May 2, 2020, 3:59 a.m. April 7, 2016, 5:51 a.m. Jan. 16, 2021, 5:25 p.m. Sept. 9, 2016, 4:58 p.m. April 11, 2019, 7:30 a.m. Oct. 29, 2020, 10:07 a.m. Dec. 5, 2017, 5:28 p.m. July 17, 2013, 5:20 p.m. Sept. 1, 2012, 7:49 a.m. Sept. 22, 2020, 4:05 a.m. May 7, 2019, 10:30 a.m. Oct. 30, 2017, 7:37 p.m. April 28, 2021, 11:58 a.m. Aug. 27, 2020, 8:48 p.m. Oct. 14, 2020, 12:44 p.m. June 4, 2021, 7:26 p.m. Sept. 15, 2017, 9:34 p.m. July 15, 2021, 4:27 p.m.
Version3.2.12.5.01.3.61.1.00.6.41.13.00.4.13.12.01.0.20.1.50.24.01.3.00.4.21.8.10.2.41.2.3n/a0.50.1.21.1.03.22.0.00.1.42.0.50.70.2.00.2.41.0.01.30.22.0.01.11.6.0n/a1.7.00.2.01.1.01.0.00.1.30.7.10.180.2.60.3.00.6.00.20.6.20.4.0n/a2.0.11.1.00.0.20.0.200.4.1.1n/a0.6.11.1.5n/a0.4.10.1.40.2.00.5.11.0.03.2.10.111.0.20.1.21.6.2
RepoGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubGithubBitbucketGithubGithubGithubGithubGithubGithubGithubGithubGithub
Commits
Stars65652162135310566874544514233573452562381761751591461411401271181029374666562605146373730292826242321201817171716151515151312121111111088776665541
Repo Forks933652248115105932098328717422111622111731649231619221511132581698n/a69646522153n/an/a5219531n/a11n/a33231n/an/a
Participantsaaugustin
matthiask
robhudson
jdufresne
dcramer
jezdez
tim-schilling
alex
bkonkle
xi
more...
bmihelac
andrewgy8
thauk-copperleaf
manelclos
mgrdcm
jdufresne
rhunwicks
shaggyfrog
jnns
qris
more...
nesdis
jay20162016
lesantana09
Raznak
mishrag
WoLpH
rudolfce
tony13tv
finderseyes
frostming
more...
sheppard
auvipy
kevinmickey
chrisdev
BertrandBordage
andrlik
fredrikburman
whyscream
ZuluPro
Parbhat
vtoupet
henhuy
aisipos
more...
saxix
PetrDlouhy
int-ua
trepmag
domdinicola
WoLpH
asfaltboy
ticosax
scrck
tdruez
more...
agateblue
youtux
Pentusha
radarhere
johnfraney
Mec-iS
waldyrious
yunti
adamchainz
pre-commit-ci[bot]
arnau126
MichaelAquilina
graingert
maikroeder
marco-santamaria
avelis
glogiotatidis
hjaarnio
more...
jaap3
semente
morlandi
pconerly
lmorchard
fedosov
kliver
timgates42
artscoop
catmidia
more...
davedash
KevinGrahamFoster
koryd-bixly
maciej-jaworski
pykler
fourk
nektor211
punchagan
andyzickler
ChrFr
more...
fabiocaccamo
neutrinoceros
sheppard
marianoeramirez
LegoStormtroopr
brad
claudep
s-i-l-k-e
gustavo-sdo
adamchainz
meshy
georgedorn
martsberger
batisteo
lilspikey
akaihola
dgouldin
kmike
ionelmc
belonesox
bacher09
willstott101
georgema1982
bitdeli-chef
mkai
arski
tony
jbaloghhenriquebastos
iurisilvio
martsberger
mauler
ckinseyDmitri-Sintsov
sam-oylov
kiwnix
melvyn-sopacua
gitter-badger
joshourisman
stefanfoulis
acdha
johbo
Chive
beniwohli
akaihola
bradmontgomery
renyi
jazztpt
more...
bradmontgomery
charles-vdulac
smaccona
toastdriven
heyman
phoebebright
remohammadi
mvillarejo
artschwagerb
dmarsh19
more...
nikhila05
ashwin31
itsderek23
tarkatronic
jwilhelm-godaddy
broxeph
kmike
hussaintamboli
bertramr
zlorf
deschler
trcodumb906cblignaut
hedleyroos
JamesJGarner
coady
dependabot[bot]
ionelmc
bitdeli-chef
sheppardvitaliyf
JocelynDelalande
madssj
bedingue
sheppard
achembarpu
tomaszn
realmhamdy
ofalk
marcosox
richleland
justquick
troymelhase
W1ldPo1nternathan-osman
srogatch
rockymeza
jxcl
nolsto
acatton
julianandrews
sheppardcenkbircanogluemacswaypriestc
adamcharnock
fish2000
bitdeli-chef
charettes
Stranger6667
midezz
n1te
saippuakauppias
bitdeli-chef
iheitlager
pyup-bot
MrSeccubus
andrewdoddvdboor
jbalogh
denizdogankakulukia
lowks
swistakm
MatthewWilkes
artemboebertti
tomatohater
gitter-badger
robertomoulin
yohanboniface
metamatik
diox
grangier
lauxley
nahuelange
chrisdavisgithub
amirouche
ldelcroix
komanaki
zerc
JoeJasinski
dependabot[bot]
Suor
mariacha
agusmakmunlazybirdsebpiqmorlandi
jayvdb
WoLpHbradmontgomeryjdetaeyeLegoStormtrooprgeoffroy-noel-ddh
jmiguelv
glooney
kamil1marczak
pyup-bot
tiagoloureiro
srtab
fmeurou
Documentation N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Fixtures
Synchronization
Querying
Backup
Import
Export
Used ForImport/ExportFiltering data from querysets without additional DB requestsApproximate Counting, Efficient iteration over large QuerySets, NoSQL lookups with HANDLERImport/Export, backupImport/Export1Generates interactive entity-relationship diagrams from Django models.Export, QueryingQueryingQueryingQuering,
Conditional Aggregations
Import/Export, Data MigrationData synchronization between databasesImport/export; automated synchronization.Export, backupDatabase backup managementMaking & loading a consistent partial DB dumpextensive model changes that need data restructuringImportQueryingIt allows to view data changes on the user-faced Frontend without saving them into the database.Allows you to use Redis datasets similar to how regular database can be managed in the Django Admin. It creates a Redis Queryset by emulating standard Django Querysets.

Within the Admin you see a fake Django Model for every Redis server and/or database. Within those apps you get the regular Model Admin list and edit interfaces.
Obfuscate
List view
Editable grid view
Reuse standard data vocabularies (Linked data).
Create your own lists.
Improve data input in Django Admin.
Obfuscate model fields text data.
Search WeightPackageDescriptionLast PyPI release:Repo ForksStars
{{ item.weight / max_weight * 100 | number:0 }}%{{ item.title }}Grid: {{ item.description }} {{ item.last_released | date: 'mediumDate' }} N/A {{ item.repo_forks }} N/A {{ item.repo_watchers }} N/A