No project description provided
Project description
Wrapper to create Spark Connect session for Spark Applications in Ocean
from ocean_spark_connect.ocean_spark_session import OceanSparkSession
spark = OceanSparkSession.Builder().cluster_id("osc-cluster").appid("appid").profile("default").getOrCreate()
spark.sql("select random()").show()
spark.stop()
Options for OceanSparkSession.Builder with and without default values
In addition to the existing SparkSession.Builder option, the following options are available:
- token
- profile
- appid
- account_id
- cluster_id
- host = "api.spotinst.io"
- port = "15002"
- bind_address = "0.0.0.0"
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for ocean_spark_connect-0.2.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | d5316460772992dcdae0fc3a89e498c3e2cca421fa9c7017c1676a9c0b53a18c |
|
MD5 | f79aa8eaece8e85f305e8a953c8b6cc4 |
|
BLAKE2b-256 | 1412425456fe05d53ec8879bd0b9b6b5d95919805053345bbad81b186518f0d7 |
Close
Hashes for ocean_spark_connect-0.2.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ffffed0fcd5b7262657171425ab5f0cce27eeac912fb33943b5e90c839ee989d |
|
MD5 | 4555bb3f0d77912409fe84e855ce0b0f |
|
BLAKE2b-256 | 843a9a21ffd9a410b2b1c71cf22f090401bf82bd03a80d03a61ea939e867deaa |