Orchid 1.1

Generic Multi Threaded Web Crawler

Orchid is a python crawler I developed for one of my graduate courses. It is a generic multi-threaded web crawler complete with documentation. We used this crawler to locate web pages which contained malicious code. However, the logic of what to do with the crawled pages is implemented in a separate class and therefore Orchid can easily be used for any application which requires crawling the web.

• Author: Eugene Vahlis
• Keywords: crawler
• Platform: any
• Requires BeautifulSoup
• Categories
  • Intended Audience :: Developers
  • Intended Audience :: Information Technology
  • Intended Audience :: Science/Research
  • License :: OSI Approved :: MIT License
  • Natural Language :: English
  • Programming Language :: Python
  • Topic :: Communications
  • Topic :: Internet :: WWW/HTTP :: Indexing/Search
  • Topic :: Utilities
• Package Index Owner: evahlis
• DOAP record: Orchid-1.1.xml