skip to navigation
skip to content

Not Logged In

Parker 0.4.0

A web spider for collecting specific data across a set of configured sites

Latest Version: 0.9.6

Parker
======

Parker is a Python-based web spider for collecting specific data
across a set of configured sites.

Non-Python requirements:

- Redis - for task queuing and visit tracking
- libxml - for HTML parsing of pages

Installation
------

Install using ``pip``::

$ pip install parker

Configuration
------

To configure Parker, you will need to install the configuration
files in a suitable location for the user running Parker. To do
this, use the ``parker-config`` script. For example::

$ parker-config ~/.parker

This will install the configuration in your homedir and will output
the related environment variable for you to set in your ``.bashrc``.


News
====

0.4.0
----------

- Added handling for a PARKER_CONFIG environment variable, allowing
users to specify where configuration files are loaded from.

- Added the ``parker-config`` script to install default configuration
files to a passed location. Also prints out an example PARKER_CONFIG
environment variable to add to your profile files.

- Updated documentation to use proper reStructuredText files.

- Add a CHANGES file to track updates.  
File Type Py Version Uploaded on Size
Parker-0.4.0.tar.gz (md5) Source 2014-07-20 134KB
  • Downloads (All Versions):
  • 254 downloads in the last day
  • 854 downloads in the last week
  • 3231 downloads in the last month