skip to navigation
skip to content

Not Logged In

spidertrap 0.1.1

Spider trap for testing crawlers

An http server that responds with an ever-expanding web of links. Use it to test, benchmark, and confuse web crawlers.

Implemented as a simple python script with no dependencies other than the standard library. Works with python 2.7 and python 3.

Installation

$ pip install spidertrap

Usage

spidertrap [-h] [-p PORT] [--fanout FANOUT]

optional arguments:
  -h, --help            show this help message and exit
  -p PORT, --port PORT  [9999]
  --fanout FANOUT       Number of links to create on each page [2]

Licence

MIT

 
File Type Py Version Uploaded on Size
spidertrap-0.1.1.tar.gz (md5) Source 2014-04-06 1KB
  • Downloads (All Versions):
  • 0 downloads in the last day
  • 18 downloads in the last week
  • 117 downloads in the last month