Skip to main content

sqlitebiter is a CLI tool to convert CSV/Excel/HTML/JSON/Markdown/Google-Sheets to a SQLite database file.

Project description

sqlitebiter

https://img.shields.io/pypi/pyversions/sqlitebiter.svg Linux CI test status Windows CI test status

Summary

sqlitebiter is a CLI tool to convert CSV/Excel/HTML/JSON/Markdown/Google-Sheets to a SQLite database file.

Features

  • Create a SQLite database file from:
    • file(s):
      • CSV

      • Microsoft Excel TM

      • HTML: extract table tag data

      • JSON

      • Markdown: extract Markdown table

    • Google Sheets

    • URL (fetch data from the Internet)

  • Multi-byte character support

Usage

Create SQLite database from files

docs/gif/usage_example.gif

Create SQLite database from URL

Convert HTML table tags within a web page to SQLite tables.

$ sqlitebiter url https://en.wikipedia.org/wiki/List_of_unit_testing_frameworks
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html1' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html2' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html3' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html4' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html5' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html6' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html7' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html8' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html9' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html10' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html11' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html12' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html13' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html14' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html15' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html16' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html18' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html19' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html20' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html21' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html22' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html23' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html24' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html25' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html26' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html27' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html28' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html29' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html30' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html31' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html32' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html33' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html34' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html35' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html36' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html37' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html38' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html39' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html40' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html41' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html42' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html43' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html44' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html45' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html46' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html47' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html48' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html49' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html50' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html51' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html52' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html53' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html54' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html55' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html56' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html57' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html58' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html59' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html60' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html61' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html62' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html63' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html64' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html65' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html66' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html67' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html68' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html69' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html70' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html71' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html72' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html73' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html74' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html75' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html76' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html77' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html78' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html79' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html80' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html81' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html82' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html83' table
convert a table to 'List_of_unit_testing_frameworks_Wikipedia_html84' table

Output SQLite database has following table structure:

List_of_unit_testing_frameworks_Wikipedia_html1 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html2 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html3 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html4 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html5 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html6 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html7 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html8 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html9 (Name TEXT, xUnit TEXT, Fixtures TEXT, Groupfixtures TEXT, Generators TEXT, Source TEXT, License TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html10 (Name TEXT, License TEXT, xUnit TEXT, Fixtures TEXT, Groupfixtures TEXT, Generators TEXT, Mocks TEXT, Exceptions TEXT, Macros TEXT, Templates TEXT, Grouping TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html11 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html12 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html13 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html14 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html15 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html16 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html18 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html19 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html20 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html21 (Name TEXT, xUnit TEXT, Fixtures TEXT, GroupFixtures TEXT, Generators TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html22 (Name TEXT, xUnit TEXT, Fixtures TEXT, Groupfixtures TEXT, Generators TEXT, MPI TEXT, OpenMP TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html23 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html24 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html25 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html26 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html27 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html28 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html29 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html30 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html31 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html32 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html33 (Name TEXT, xUnit TEXT, TAP TEXT, Clientside TEXT, Serverside TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html34 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html35 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html36 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html37 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html38 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html39 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html40 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html41 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html42 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html43 (Name TEXT, xUnit TEXT, TAP TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html44 (Name TEXT, xUnit TEXT, TAP TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html45 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html46 (Name TEXT, xUnit TEXT, TAP TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html47 (Name TEXT, xUnit TEXT, TAP TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html48 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html49 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html50 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html51 (Name TEXT, xUnit TEXT, Generators TEXT, Fixtures TEXT, GroupFixtures TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html52 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html53 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html54 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html55 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html56 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html57 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html58 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html59 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html60 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html61 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html62 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html63 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html64 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html65 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html66 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html67 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT, Active TEXT)
List_of_unit_testing_frameworks_Wikipedia_html68 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT, Active TEXT)
List_of_unit_testing_frameworks_Wikipedia_html69 (Name TEXT, xUnit TEXT, TAP TEXT, Source TEXT, Remarks TEXT, Active TEXT)
List_of_unit_testing_frameworks_Wikipedia_html70 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html71 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html72 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html73 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html74 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html75 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html76 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html77 (Name TEXT, Source TEXT)
List_of_unit_testing_frameworks_Wikipedia_html78 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html79 (Name TEXT, xUnit TEXT, License TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html80 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html81 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html82 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html83 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)
List_of_unit_testing_frameworks_Wikipedia_html84 (Name TEXT, xUnit TEXT, Source TEXT, Remarks TEXT)

For more information

More examples are available at http://sqlitebiter.readthedocs.io/en/latest/pages/usage/index.html

Installation

Install via pip

sqlitebiter can be installed via pip (Python package manager).

sudo pip install sqlitebiter

Dependencies

Python packages (mandatory)

Dependency python packages are automatically installed during sqlitebiter installation via pip.

Google Sheets dependencies

Manual installation required to use Google Sheets feature.

Test dependencies

Python packages (optional)

  • lxml (Faster HTML convert if installed)

Documentation

http://sqlitebiter.readthedocs.org/en/latest/

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sqlitebiter-0.4.2.tar.gz (13.4 kB view hashes)

Uploaded Source

Built Distribution

sqlitebiter-0.4.2-py2.py3-none-any.whl (10.4 kB view hashes)

Uploaded Python 2 Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page