Skip to main content

Scrapy extension Feed Exporter Storage Backend to export items to an SFTP server

Project description

PyPI Version License

scrapy-feedexporter-sftp is a Scrapy Feed Exporter Storage Backend that allows you to export Scrapy items to an SFTP server.

Using scrapy-feedexporter-sftp

Add a FEED_STORAGES to your Scrapy settings:

FEED_STORAGES = {"sftp": "scrapy_feedexporter_sftp.SFTPFeedStorage"}

Define your FEED_URI in Scrapy settings:

FEED_URI = "sftp://user:password@some.server:/some/path/to/a/file"

Testing scrapy-feedexporter-sftp

Install an ssh server, create a user and run:

export FEEDTEST_SFTP_URI='sftp://user:password@localhost:/some/path/to/a/file'
export FEEDTEST_SFTP_PATH='/some/path/to/a/file'
tox

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

scrapy-feedexporter-sftp-1.0.4.tar.gz (2.6 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page