UNKNOWN
Project description
Item definition and utils for storing items in CDR format for scrapy.
Install
pip install scrapy-cdr
Usage
from scrapy_cdr import text_cdr_item
def parse(response):
yield text_cdr_item(
response,
crawler_name='my scrapy crawler',
team_name='my team',
metadata={'extra': 'metadata'}, # optional
item_cls=MyCDRItem, # optional
)
There is also scrapy_cdr.cdr_item for non-text items, and item definition in scrapy_cdr.CDRItem.
License
License is MIT.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-cdr-0.1.2.tar.gz
(2.4 kB
view hashes)
