skip to navigation
skip to content

spidertrap 0.1.1

Spider trap for testing crawlers

An http server that responds with an ever-expanding web of links. Use it to test, benchmark, and confuse web crawlers.

Implemented as a simple python script with no dependencies other than the standard library. Works with python 2.7 and python 3.


$ pip install spidertrap


spidertrap [-h] [-p PORT] [--fanout FANOUT]

optional arguments:
  -h, --help            show this help message and exit
  -p PORT, --port PORT  [9999]
  --fanout FANOUT       Number of links to create on each page [2]



File Type Py Version Uploaded on Size
spidertrap-0.1.1.tar.gz (md5) Source 2014-04-06 1KB