No project description provided
Project description
Wrapper to create Spark Connect session for Spark Applications in Ocean
from ocean_spark_connect.ocean_spark_session import OceanSparkSession
spark = OceanSparkSession.Builder().cluster_id("osc-cluster").appid("appid").profile("default").getOrCreate()
spark.sql("select random()").show()
spark.stop()
Options for OceanSparkSession.Builder with and without default values
In addition to the existing SparkSession.Builder option, the following options are available:
- token
- profile
- appid
- account_id
- cluster_id
- host = "api.spotinst.io"
- port = "15002"
- bind_address = "0.0.0.0"
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for ocean_spark_connect-0.2.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 043315a7846312860cd416d883a4df93ac49d9e7ad50a7ed5cd5c9054517a0d7 |
|
MD5 | dbce4b22223b087f47916a124e0a9087 |
|
BLAKE2b-256 | fca843db22953661f2095e3c723fc02d78a9c26f1ce8a1d1afe92e1284a726a8 |
Close
Hashes for ocean_spark_connect-0.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e5e4451d38f2071fdaf599431a686fc7a0fde7cc38fd3471ec4f5d3659e492cf |
|
MD5 | c89b766a376a1dd0869c70089945e8aa |
|
BLAKE2b-256 | 623559f0a60543ce14ff886007df006794b1ae1cb5ae617f6dca6555b4a3a795 |