Skip to main content

Spidy scripting language for Web scraping

Project description

https://badge.fury.io/py/Spidy.png https://travis-ci.org/AlexPereverzyev/spidy.svg

Overview

Spidy is an open source scripting language for Web scraping. Spidy makes scraping easy because it has:

* Flexibility of scripting language
* XPath selectors to extract data
* Support for HTML and JSON formats
* Templates for output formatting

Requirements

Spidy is written in Python and relies on Python Standard Library only.

  • Python 2.7

  • Mac OS X, Windows, Linux, BSD

Install

Installing from Python Package Index:

pip install spidy

For Windows installation instructions, please see documentation in docs directory.

Usage

‘Hello world’ example with Spidy shell:

import spidy
print spidy.do('''return 'Hello, world!' ''')

Documentation

Documentation is available in the docs directory. Script examples are located in examples directory.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Spidy-0.1.tar.gz (50.3 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page