skip to navigation
skip to content

Not Logged In

django-scraper 0.1

Django application which crawls and downloads online content following instructions

Latest Version: 0.3.8

django-scraper is a Django application which crawls and downloads online content following configurable instructions.

  • Extract content of given online websites/pages using XPath queries.
  • Automatically browse and download content in related pages, with given depth.
  • Support metadata extract along with other content
  • Have content refinement rules and black words filtering
  • Store and prevent duplication of downloaded content
  • Support HTTP, HTTPS proxies.

Documentation

The full documentation is not ready yet, please go here for notes about installation and usage: https://github.com/zniper/django-scraper

Support

If you have any questions or any ideas regarding this application, please email to me[at]zniper.net

 
File Type Py Version Uploaded on Size
django-scraper-0.1.tar.gz (md5) Source 2014-07-04 6KB
  • Downloads (All Versions):
  • 6 downloads in the last day
  • 183 downloads in the last week
  • 897 downloads in the last month