skip to navigation
skip to content

Not Logged In

WebHDFS 0.2.0

HDFS Python client based on WebHDFS REST API

# WebHDFS Python Client Implementation

WebHDFS is REST-API to HDFS. To facilitate access to WebHDFS from Python, webhdfs-py was developed. The library can easily be installed via easy_install or pip:

easy_install webhdfs

Webhdfs-py has no further dependencies and solely relies on the Python standard library. Similar to the Python os package, webhdfs-py provides basic capabilities like the creation/listing and deletion of directories on files.

## Hadoop configuration

Ensure that WebHDFS is enabled in the `hdfs-site.xml`:

Relevant properties:

        <property>
                <name>dfs.webhdfs.enabled</name>
                <value>true</value>
         </property>

see <http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html>


## Limitations

        * Kerberos security not supported
 
File Type Py Version Uploaded on Size
WebHDFS-0.2.0.tar.gz (md5) Source 2014-01-20 3KB
  • Downloads (All Versions):
  • 36 downloads in the last day
  • 412 downloads in the last week
  • 1079 downloads in the last month