A Simple Web Crawling and Web Scraping framework

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for wuyue from gravatar.com wuyue

Unverified details

These details have not been verified by PyPI
Project links
GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Meta

License: BSD

Author: wuyue

Project description

Crwy

PyPI Version Build Status Documentation Status

简介

Crwy是一个轻量级的爬虫抓取框架，参考Scrapy框架结构开发而来。该框架提供了实用的爬虫模板，旨在帮助大家快速实现爬虫任务，高效开发。

运行环境

  • Python2.7

  • Works on Linux, Mac OSX

依赖包

  • beautifulsoup4>=4.5.1

  • pycurl>=7.43.0

  • configparser>=3.5.0

  • SQLAlchemy>=1.0.14

  • MySQL-python>=1.2.5

安装

快速安装:

pip install crwy

or 前往下载: https://pypi.python.org/pypi/Crwy/1.0.1/

使用手册

在这里: http://crwy.readthedocs.io/zh_CN/1.0.1/

友情链接

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for wuyue from gravatar.com wuyue

Unverified details

These details have not been verified by PyPI
Project links
GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Meta

License: BSD

Author: wuyue


Release history Release notifications | RSS feed

1.7.1

1.7.0

1.6.0

1.5.7

1.5.6

1.5.5

1.5.4

1.5.3

1.5.2

1.5.1

1.5.0

1.4.0

1.3.2

1.3.1

1.3.0

1.2.0

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.0.9

1.0.8

1.0.7

1.0.6

1.0.5

1.0.3

1.0.2

This version

1.0.1

1.0.0

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page