Skip to main content

scrapes spotify starting from an artist id, stores in sqlite

Project description

Spotiflite

Build Status Latest Version

Scrapes Spotify and dumps data to a sqlite3 database.

  • Uses requests to make queries, with pythonic user-agent
  • sleeps randomly between each HTTP call
  • is NOT in a hurry to get anywhere
  • has nice 80's cli interface

Install

$ pip install spotiflite

then go somewhere and setup a database:

$ spotiflite setup

you can also specify the db filename:

$ spotiflite --spotifydb=this/awesome/db setup

Usage

For example scrape Frank ෴ Zappa

$ spotiflite scrape 6ra4GIOgCZQZMOaUECftGN 
got 44 artist ids
extracted data for Tom Waits
saved data for Tom Waits
got 8 artist ids
extracted data for Elmer Snowden
saved data for Elmer Snowden
got 6 artist ids
extracted data for Wesley Willis
saved data for Wesley Willis
...

while its running you can get stats in another window

$ spotiflite stats 
rows: 9882
completed: 1395
jobs to do: 8487
DB size: 48.04 MB

Cli usage

Usage: spotiflite.py [OPTIONS] COMMAND [ARGS]...

Options:
  -db, --spotifydb TEXT  sqlite filename [default: spotify.db]
  --help                 Show this message and exit.

Commands:
  scrape    starts scraping from given artist id
  setup     creates tables
  stats     print out db stats
  teardown  deletes tables

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

spotiflite-1.0.0.tar.gz (5.3 kB view hashes)

Uploaded Source

Built Distribution

spotiflite-1.0.0-py3-none-any.whl (7.0 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page