skip to navigation
skip to content

Not Logged In

django-scraper 0.2.3

Django application which crawls and downloads online content following instructions


  • Extract content of given online websites/pages using XPath queries.
  • Process can be started from command line (~cron job) or inside Django code
  • Can be called from command line (~cron job) or inside Django code
  • Automatically browse and download content in related pages, with given depth.
  • Support metadata extract along with other content
  • Have content refinement rules and black words filtering
  • Store and prevent duplication of downloaded content
  • Allow changing User Agent
  • Support proxy servers


The full documentation is not ready yet, please go here for notes about installation and usage:


If you have any questions about this application, please email to me[at]

File Type Py Version Uploaded on Size
django-scraper-0.2.3.tar.gz (md5) Source 2015-03-12 72KB
  • Downloads (All Versions):
  • 14 downloads in the last day
  • 75 downloads in the last week
  • 273 downloads in the last month