Skip to main content

Utilities to extend Scrapy spiders with usable metadata.

Project description

PyPI version Supported Python versions Build status Coverage report Documentation status

scrapy-spider-metadata is a Python 3.8+ library of utilities to extend Scrapy spiders with usable metadata.

In particular, it provides a nice way for Scrapy spiders to define, validate, document and pre-process their arguments as pydantic models.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page