Skip to main content
PyCon US is happening May 14th-22nd in Pittsburgh, PA USA.  Learn more

A service for running Scrapy spiders, with an HTTP API

Project description

PyPI Version Build Status Coverage Status Python Version Pypi Downloads

Scrapyd is a service for deploying and running Scrapy spiders.

It allows you to upload Scrapy projects and control their spiders using a JSON API.

(If you are viewing this on GitHub, open the full documentation for additional details.)

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page