Skip to main content

Lassie is a Python library for retrieving basic content from websites

Project description

https://img.shields.io/pypi/v/lassie.svg?style=flat-square https://img.shields.io/pypi/dw/lassie.svg?style=flat-square https://img.shields.io/travis/michaelhelmick/lassie.svg?style=flat-square https://img.shields.io/coveralls/michaelhelmick/lassie/master.svg?style=flat-square

Lassie is a Python library for retrieving basic content from websites.

https://i.imgur.com/QrvNfAX.gif

Usage

>>> import lassie
>>> lassie.fetch('http://www.youtube.com/watch?v=dQw4w9WgXcQ')
{
    'description': u'Music video by Rick Astley performing Never Gonna Give You Up. YouTube view counts pre-VEVO: 2,573,462 (C) 1987 PWL',
    'videos': [{
        'src': u'http://www.youtube.com/v/dQw4w9WgXcQ?autohide=1&version=3',
        'height': 480,
        'type': u'application/x-shockwave-flash',
        'width': 640
    }, {
        'src': u'https://www.youtube.com/embed/dQw4w9WgXcQ',
        'height': 480,
        'width': 640
    }],
    'title': u'Rick Astley - Never Gonna Give You Up',
    'url': u'http://www.youtube.com/watch?v=dQw4w9WgXcQ',
    'keywords': [u'Rick', u'Astley', u'Sony', u'BMG', u'Music', u'UK', u'Pop'],
    'images': [{
        'src': u'http://i1.ytimg.com/vi/dQw4w9WgXcQ/hqdefault.jpg?feature=og',
        'type': u'og:image'
    }, {
        'src': u'http://i1.ytimg.com/vi/dQw4w9WgXcQ/hqdefault.jpg',
        'type': u'twitter:image'
    }, {
        'src': u'http://s.ytimg.com/yts/img/favicon-vfldLzJxy.ico',
        'type': u'favicon'
    }, {
        'src': u'http://s.ytimg.com/yts/img/favicon_32-vflWoMFGx.png',
        'type': u'favicon'
    }],
    'locale': u'en_US'
}

Install

Install Lassie via pip

$ pip install lassie

or, with easy_install

$ easy_install lassie

But, hey… that’s up to you.

Documentation

Documentation can be found here: https://lassie.readthedocs.org/

History

0.7.2 (2016-08-01)

  • Add status_code to response dictionary (for “file-like” responses, as well)

0.7.1 (2016-07-27)

  • Add support for open graph site_name

0.7.0 (2016-07-01)

  • Add status_code to response dictionary

0.6.2 (2015-11-11)

  • Pinned requests library to version 2.8.1

  • Pinned beautifulsoup4 library to version 4.4.1

  • Add Python 3.5 to Travis CI build matrix (officially support 3.5)

0.6.1 (2015-10-30)

  • Catch and raise LassieError on HEAD requests when handle_file_content is passed to the Lassie API

  • Pinned requests library to version 2.8.0

0.6.0 (2015-08-19)

  • Support for secure url image and videos from Open Graph

  • Simplified merge_settings and data updating internally

0.5.3 (2015-07-02)

  • Handle when a website doesn’t set a value on the “keywords” meta tag

0.5.2 (2015-04-16)

  • Updated requests and beautifulsoup4 library versions

0.5.1 (2014-08-05)

  • Fix issue where headers didn’t always have ‘Content-Type’ key

0.5.0 (2014-06-23)

  • Added ability to fetch links that are image files (jpg, gif, png, bmp)

  • Renamed _retreive_content to _retrieve_content because I evidently don’t know how to spell correctly

0.4.0 (2013-09-30)

  • Updated requests and beautifulsoup4 library versions

  • Added support for manipulating the request, see Advanced Usage docs

  • Fixed issue where lassie.fetch would break if the page had no title

  • Lassie is now more lenient when it comes to width and height values of images (now accepts integers (100) or integer with px (100px)

  • Image URLs for all images are now absolute

0.3.0 (2013-08-15)

  • Added support for locale to be returned. If lang is specified in the html tag and it normalizes to an actual locale, it will be added to the returned data.

  • Fixed bug where height was not being returned for body images

  • Added test coverage, we’re 100% covered! :D

0.2.1 (2013-08-13)

  • Remove spaces from the returned keywords list

  • Fixed issue where favicon was not being retrieved

  • Fixed priority for class level vs method level params

0.2.0 (2013-08-06)

  • Fix package error when importing

0.1.0 (2013-08-05)

  • Initial Release

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

lassie-0.7.2.tar.gz (10.3 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page