a hobby crawler
Project description
Bamboo Crawler
A Hobby Crawler. It is almost under construction.
Usage
Installation
$ pip install bamboo-crawler
Run
$ bamboo --recipe recipe.yml
Recipe
mytask:
input:
type: ConstantInputter
options:
value: http://httpbin.org/robots.txt
process:
type: HTTPCrawler
output:
type: StdoutOutputter
License
BSD-3-Clause License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
bamboo-crawler-0.1.3.zip
(22.6 kB
view hashes)