skip to navigation
skip to content

Not Logged In

sparklingpandas 0.0.1

Enable Pandas on PySpark


SparklingPandas aims to make it easy to use the distributed computing power of PySpark to scale your data anlysis with Pandas.


None (right now). You can find some slides in the slides/ directory


The primary requirement of SparklingPandas is that you have a recent (v1.0-SNAPSHOT currently) version of Spark installed - <http:"">


Make sure you have the SPARK_HOME enviroment variable set correctly, as SparklingPandas uses this for including the PySpark libraries

Other than that you can install SparklingPandas with pip and just import it. The primary unit of SparklingPandas is a PRDD (Pandas Resillent Distributed Data Set)


This is in early development and should not be considered usable.


There isn't really a mailing list, but if you want to use please feel free to e-mail me ( ) with any questions.  
File Type Py Version Uploaded on Size
sparklingpandas-0.0.1.tar.gz (md5) Source 2014-08-20 14KB
  • Downloads (All Versions):
  • 4 downloads in the last day
  • 32 downloads in the last week
  • 113 downloads in the last month