Skip to main content

Helper package for the Data Engineering course at Colorado School of Mines

Project description

Mines Data Engineering

This package simplifies the process of starting common database systems in the background on Singularity Hub.

Supported Databases

  • MongoDB
  • TimescaleDB (and Postgres)

Examples

MongoDB

from mines_data_engineering import start_mongo
import pymongo

# will need wait a couple minutes the first time this happens
# while Singularity downloads and converts the Docker image
connection_string = start_mongo()

client = pymongo.MongoClient(connection_string)
client.my_db.my_col.insert_one({'finally': 'working'})

Postgres/TimescaleDB

from mines_data_engineering import start_postgres
import psycopg2


# will need wait a couple minutes the first time this happens
# while Singularity downloads and converts the Docker image
connection_string = start_postgres()

conn = psycopg2.connect(connection_string)
cur = conn.cursor()
cur.execute("SELECT 1")
assert next(cur) == (1,)

Project details


Release history Release notifications | RSS feed

This version

0.1.7

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mines_data_engineering-0.1.7.tar.gz (8.2 kB view hashes)

Uploaded Source

Built Distribution

mines_data_engineering-0.1.7-py3-none-any.whl (9.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page