PyCon US is happening May 14th-22nd in Pittsburgh, PA USA.  Learn more

Tokern Data Catalog

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for jhecking from gravatar.com jhecking Avatar for tokern from gravatar.com tokern

Unverified details

These details have not been verified by PyPI
Project links
Meta
  • License: MIT License (MIT)
  • Author: Tokern
  • Tags data-catalog, postgres, snowflake, redshift, glue, bigquery
  • Requires: Python >=3.8, <=3.10.8
Classifiers

Project description

dbcat PyPI image image

Data Catalog for Databases and Data Warehouses

Overview

dbcat scans and maintains metadata from all your databases and data warehouses. dbcat also stores metadata generated by other data governance applications such as PIICatcher and Lineage Engine. dbcat is typically used alongside other applications. It can also be used stand-alone to generate a very simple data catalog using the CLI or API.

dbcat stores the catalog in a Postgresql or SQLite database. By default, the catalog is stored in a SQLite database in ~/.config/tokern/catalog.db

The catalog can be exported to Datahub or Amundsen. This is very useful to export PII tags or column lineage generated by PIICatcher or Lineage Engine. Check documentation for detailed instructions to set PII tags and column-level lineage.

Quick Start

dbcat is distributed as a python application.

python3 -m venv .env
source .env/bin/activate
pip install dbcat

dbcat catalog add-sqlite --name sample --path <path to sqlite db>
dbcat catalog scan --source-name sample

Documentation

For advanced usage refer documentation Catalog Documentation.

Supported Technologies

The following databases are supported:

  • MySQL/Mariadb
  • PostgreSQL
  • AWS Redshift
  • BigQuery
  • Snowflake
  • AWS Athena

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page