No project description provided
Project description
Wrapper to create Spark Connect session for Spark Applications in Ocean
from ocean_spark_connect.ocean_spark_session import OceanSparkSession
spark = OceanSparkSession.Builder().cluster_id("osc-cluster").appid("appid").profile("default").getOrCreate()
spark.sql("select random()").show()
spark.stop()
Options for OceanSparkSession.Builder with and without default values
In addition to the existing SparkSession.Builder option, the following options are available:
- token
- profile
- appid
- account_id
- cluster_id
- host = "api.spotinst.io"
- port = "15002"
- bind_address = "0.0.0.0"
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for ocean_spark_connect-0.3.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | b38d144ae1c179301d297a4578d48d4ac5443a9e93f391bcd0bf2283adefb3ac |
|
MD5 | 412e9e7c61ec2a4fb455bb75812d85be |
|
BLAKE2b-256 | d50c53619e7c97c48e7cab6a7a1185f82a9e5a10f2581747c6538f2663bdf3c7 |
Close
Hashes for ocean_spark_connect-0.3.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e7e757696122b80d771eeba255ee24083ad01e43484f09bf90d0f7cab91ced97 |
|
MD5 | 8d8ebd22684211c07df7cccd2615ccb9 |
|
BLAKE2b-256 | 33630acc9b183de7af7a8d97c224bd51a1e1c9b7b96782c57628d7bfd73b0aaf |