Skip to main content

spark_generated_rules_tools

Project description

spark_generated_rules_tools

Github License Updates Python 3 Code coverage

spark_generated_rules_tools is a Python library that implements quality rules in sandbox

Installation

The code is packaged for PyPI, so that the installation consists in running:

Usage

wrapper create hammurabies

Sandbox

Installation

!yes| pip uninstall spark-generated-rules-tools
pip install spark-generated-rules-tools --user --upgrade

IMPORTS

import os
import pyspark

from spark_generated_rules_tools import dq_validate_rules

Variables

user_sandbox="P030772"

Creating Workspace

dq_path_workspace(user_sandbox=user_sandbox)

Run

dq_run_sandbox(spark=spark,
               sc=sc,
               parameter_conf_list=parameter_conf_list,
               url_conf=url_conf)

License

Apache License 2.0.

New features v1.0

BugFix

  • choco install visualcpp-build-tools

Reference

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page