pholcidae - Tiny python web crawler library
Project description
pholcidae - Tiny python web crawler library
=========
Pholcidae
------------
Pholcidae, commonly known as cellar spiders, are a spider family in the suborder Araneomorphae.
About
------------
Pholcidae is a tiny Python module allows you to write your own crawl spider fast and easy.
Dependencies
------------
* python >= 2.6.x
Basic example
------------
from pholcidae import Pholcidae
class MySpider(Pholcidae):
settings = {'domain': 'www.test.com', 'start_page': '/sitemap/'}
def crawl(self, data):
print(data.url)
spider = MySpider()
spider.start()
=========
Pholcidae
------------
Pholcidae, commonly known as cellar spiders, are a spider family in the suborder Araneomorphae.
About
------------
Pholcidae is a tiny Python module allows you to write your own crawl spider fast and easy.
Dependencies
------------
* python >= 2.6.x
Basic example
------------
from pholcidae import Pholcidae
class MySpider(Pholcidae):
settings = {'domain': 'www.test.com', 'start_page': '/sitemap/'}
def crawl(self, data):
print(data.url)
spider = MySpider()
spider.start()
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
pholcidae-0.0.3.zip
(5.0 kB
view hashes)
