Not Logged In
oyster 0.2.0
a library for scraping things
Latest Version: 0.3.2
oyster is a service for tracking regularly-accessed pages, a sort of proactive cache.
It features a daemon, a command line client for interacting with the tracking list, and a web frontend for viewing the status.
oyster was created by James Turk for Sunlight Labs.
Source is available via GitHub
## ADD PyPI link after release
Installation
Requirements
- python 2.7
- mongodb 1.8
- pymongo 1.11
- scrapelib 0.5.5
Usage
- Run celeryd with beat celeryd -B --config=oyster.celeryconfig
- Run oyster HTTP portal python oyster/web.py
- Use oyster.client.Client to add new documents & query the store
| File | Type | Py Version | Uploaded on | Size | # downloads |
|---|---|---|---|---|---|
| oyster-0.2.0.tar.gz (md5) | Source | 2011-09-20 | 1KB | 289 | |
- Author: James Turk
- Home Page: http://github.com/sunlightlabs/oyster/
- License: BSD
- Platform: any
- Categories
- Package Index Owner: jamesturk
- DOAP record: oyster-0.2.0.xml