No project description provided
Project description
Wrapper to create Spark Connect session for Spark Applications in Ocean
from ocean_spark_connect.ocean_spark_session import OceanSparkSession
spark = OceanSparkSession.Builder().cluster_id("osc-cluster").appid("appid").profile("default").getOrCreate()
spark.sql("select random()").show()
spark.stop()
Options for OceanSparkSession.Builder with and without default values
In addition to the existing SparkSession.Builder option, the following options are available:
- token
- profile
- appid
- account_id
- cluster_id
- host = "api.spotinst.io"
- port = "15002"
- bind_address = "0.0.0.0"
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for ocean_spark_connect-0.1.10.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 5b04d2a2ffbb394f7e6bccc417534d9eb30ec0367f9aa7a357e12e0735fcee2f |
|
MD5 | 2e632ba2acf132d31b4a5a85a48f77a5 |
|
BLAKE2b-256 | 2b12ed880ec73467b363b5cb83047e4221b20ec9feeeb49a40e07876e30db1fb |
Close
Hashes for ocean_spark_connect-0.1.10-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 33371fa829be6073e729b2156ba37ac92a09d544512091deddcba2a6d11da288 |
|
MD5 | d04580cbe69182cbb3594f903a8b6711 |
|
BLAKE2b-256 | e668c13c71360ed151fd51089082302a1c6a33f6c3c16935d938defbbec024d5 |