Skip to main content

Compress, encrypt (symmetric encryption) and upload files directly to Amazon S3/Glacier in a single command. Can also be used as a python module.

Project description

Compress, encrypt (symmetric encryption) and upload files directly to Amazon S3/Glacier in a single command. Can also be used as a python module.

While navigating directories, I was tired of telling myself I should backup these #?!!* small files/directories. Since I didn’t found any solution that allows me to quickly perform encrypted backup on Amazon S3 from command-line, I wrote bakthat !

Here are some features:

  • Hold everything in StringIO Objects

  • Compress with tarfile

  • Encrypt with beefish

  • Upload/download to S3 or Glacier with boto

  • Local Glacier inventory stored with shelve

  • Automatically handle/backup/restore a custom Glacier inventory to S3

You can restore backups with or without bakthat, you just have to download the backup, decrypt it with Beefish command-line tool and untar it.

Overview

$ cd /dir/i/want/to/bak
$ bakthat backup
INFO: Backing up /dir/i/want/to/bak
Password:
$

$ bakthat backup -d glacier
INFO: Backing up /dir/i/want/to/bak
Password:
$


$ bakthat restore -f bak
INFO: Restoring bak20120928.tgz.enc
Password:
$


$ bakthat restore -f bak -d glacier
INFO: Restoring glaciervault.py20121018.tgz.enc
INFO: Job ArchiveRetrieval: InProgress (2012-10-17T22:02:06.768Z/None)
INFO: Not completed yet
$

$ bakthat ls
INFO: S3 Bucket: bakthattest
INFO: bak20120928.tgz.enc

Requirements

Installation

$ pip install bakthat

You need to set your AWS credentials:

$ bakthat configure

Usage

Basic usage, “bakthat -h” or “bakthat <command> -h” to show the help.

S3 is the default destination, to use Glacier just add “-d glacier” or “–destination glacier”.

Backup

$ cd /dir/i/want/to/bak
backup to S3
$ bakthat backup
or
$ bakthat backup -f /dir/i/want/to/bak

you can also backup a single file
$ bakthat backup -f /home/thomas/mysuperfile.txt

backup to Glacier
$ bakthat backup -d glacier

Restore

You can restore the latest version of a backup just by specifying the begining of the filename.

$ mo2s3 restore --f bak

if you want to restore an older version
$ mo2s3 restore --f bak20120927
or
$ mo2s3 restore --f bak20120927.tgz.enc

restore from Glacier
$ mo2s3 restore --f bak -d glacier

When restoring from Glacier, the first time you call the restore command, the job is initiated, then you can check manually whether or not the job is completed (it takes 3-5h to complete), if so the file will be downloaded and restored.

List

$ bakthat ls
or
$ bakthat ls -d s3

$ bakthat ls -d glacier

Backup/Restore Glacier inventory

Bakthat automatically backup the local Glacier inventory (a dict with filename => archive_id mapping) to your S3 bucket under the “bakthat_glacier_inventory” key.

You can trigger a backup mannualy:

$ bakthat backup_glacier_inventory

And here is how to restore the glacier inventory from S3:

bakthat restore_glacier_inventory

As a module

import bakthat
aws_conf = {"access_key":"", "secret_key":"", "bucket": "", "vault": ""}

bakthat.backup("/dir/i/wanto/bak", conf=aws_conf)
bakthat.backup("/dir/i/wanto/bak", conf=aws_conf, destination="glacier")

# or if you want to have generated the configuration file with "bakthat configure"
# and want to use this file:
bakthat.backup("/dir/i/wanto/bak")

# you can optionally pass a custom logger
bakthat.backup("/dir/i/wanto/bak", logger=my_logger_instance, conf=aws_conf)

# restore in the current working directory
bakthat.restore("bak", logger=my_logger_instance, conf=aws_conf)

License (MIT)

Copyright (c) 2012 Thomas Sileo

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the “Software”), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bakthat-0.2.0.tar.gz (6.5 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page