skip to navigation
skip to content

Parker 0.5.0

A web spider for collecting specific data across a set of configured sites

Latest Version: 0.9.6

Parker is a Python-based web spider for collecting specific data across a set of configured sites.

Non-Python requirements:

  • Redis - for task queuing and visit tracking
  • libxml - for HTML parsing of pages


Install using pip:

$ pip install parker


To configure Parker, you will need to install the configuration files in a suitable location for the user running Parker. To do this, use the parker-config script. For example:

$ parker-config ~/.parker

This will install the configuration in your homedir and will output the related environment variable for you to set in your .bashrc.



  • Update ConsumeModel to post process the data. This enables us to populate specific data from a reference to a key-value field.
  • Reorder changes so newest first, and rename to “Changes” in the long description.


  • Bug fix to fix RST headers which may be the problem.
  • Remove the decode/encode which is not the issue.


  • Bug fix to see if RST in ASCII fixes issues on PyPI.


  • Added handling for a PARKER_CONFIG environment variable, allowing users to specify where configuration files are loaded from.
  • Added the parker-config script to install default configuration files to a passed location. Also prints out an example PARKER_CONFIG environment variable to add to your profile files.
  • Updated documentation to use proper reStructuredText files.
  • Add a CHANGES file to track updates.
File Type Py Version Uploaded on Size
Parker-0.5.0-py2.py3-none-any.whl (md5) Python Wheel 2.7 2014-07-20 16KB
Parker-0.5.0.tar.gz (md5) Source 2014-07-20 134KB