skip to navigation
skip to content

robot-detection 0.3

Library for detecting if a HTTP User Agent header is likely to be a bot

# robot_detection

robot_detection is a python module to detect if a given HTTP User Agent is a web crawler. It uses the list of registered robots from (Robots Database)[

## Usage

There is only one, function, is_robot that takes a string (unicode or not) and returns True iff that string matches a known robot in the robot database

### Example

>>> import robot_detection
>>> robot_detection.is_robot(user_agent_string)

## Updating

You can download a new version of the Robot Database from (this link)[].

Download the database dump, and run the file with the file as first argument.

$ wget $ python all.txt

If the database has changed, it’ll print out the new version of robot_useragents variable that you need to put into the source code.

## Tests

Some simple unittests are included. Running the file will run the tests.

File Type Py Version Uploaded on Size
robot-detection-0.3.tar.gz (md5) Source 2012-05-02 78KB
  • Downloads (All Versions):
  • 0 downloads in the last day
  • 4 downloads in the last week
  • 422 downloads in the last month