skip to navigation
skip to content

Not Logged In

grab 0.5.5

Web Scraping Framework

Package Documentation

Grab is a python web scraping framework. Grab provides tons of helpful methods to scrape web sites and to process the scraped content:

  • Automatic cookies (session) support
  • HTTP and SOCKS proxy with and without authorization
  • Keep-Alive support
  • IDN support
  • Tools to work with web forms
  • Easy multipart file uploading
  • Flexible customization of HTTP requests
  • Automatic charset detection
  • Powerful API of extracting info from HTML documents with XPATH queries
  • Asynchronous API to make thousands of simultaneous queries. This part of library called Spider and it is too big to even list its features in this README.
  • Python 3 ready
  • And much, much more
  • Grab has written by the guy who is doing site scraping since 2005

Check out docs (RU): Check out docs (EN):

Example of Grab usage:

from grab import Grab

g = Grab()
g.set_input('login', 'lorien')
g.set_input('password', '***')
for elem in'//ul[@id="repo_listing"]/li/a'):
    print '%s: %s' % (elem.text(), elem.attr('href'))

Example of Grab::Spider usage:

from grab.spider import Spider, Task
import logging

class ExampleSpider(Spider):
    def task_generator(self):
        for lang in ('python', 'ruby', 'perl'):
            url = '' % lang
            yield Task('search', url=url)

    def task_search(self, grab, task):

bot = ExampleSpider()


Pip is recommended way to install Grab and its dependencies:

$ pip install grab

See details here


Russian docs:

English docs in progress:

Mailing List (Ru/En languages):


If you have found a bug or wish a new feature please open new issue on github:

File Type Py Version Uploaded on Size
grab-0.5.5.tar.gz (md5) Source 2015-03-27 157KB
  • Downloads (All Versions):
  • 119 downloads in the last day
  • 2323 downloads in the last week
  • 9508 downloads in the last month