Azure storage transfer tool and data movement library
Project description
[](https://azurebatch.visualstudio.com/blobxfer/_build/latest?definitionId=12)
[](https://travis-ci.org/Azure/blobxfer)
[](https://ci.appveyor.com/project/alfpark/blobxfer)
[](https://codecov.io/gh/Azure/blobxfer)
[](https://pypi.python.org/pypi/blobxfer)
[](https://hub.docker.com/r/alfpark/blobxfer)
[](http://microbadger.com/images/alfpark/blobxfer)
# blobxfer
`blobxfer` is an advanced data movement tool and library for Azure Storage
Blob and Files. With `blobxfer` you can copy your files into or out of Azure
Storage with the CLI or integrate the `blobxfer` data movement library into
your own Python scripts.
## Major Features
* Command-line interface (CLI) providing data movement capability to and
from Azure Blob and File Storage
* Standalone library for integration with scripts or other Python packages
* High-performance design with asynchronous transfers and disk I/O
* Supports ingress, egress and synchronization of entire directories,
containers and file shares
* YAML configuration driven execution support
* Fine-grained resume support including resuming a broken operation
within a file or object
* Vectored IO support
* `stripe` mode allows striping a single file across multiple blobs (even
to multiple storage accounts) to break through single blob or fileshare
throughput limits
* `replica` mode allows replication of a file across multiple destinations
including to multiple storage accounts
* Synchronous copy with cross-mode (object transform) replication support
(including block-level copies for Block blobs)
* Client-side encryption support
* Support all Azure Blob types and Azure Files for both upload and download
* Advanced skip options for rsync-like operations
* Store/restore POSIX filemode and uid/gid
* Support reading/pipe from `stdin` including to page blob destinations
* Support reading from blob and file share snapshots for downloading and
synchronous copy
* Support for setting access tier on objects for uploading and synchronous
copy
* Configurable one-shot block upload support
* Configurable chunk size for both upload and download
* Automatic block size selection for block blob uploading
* Automatic uploading of VHD/VHDX files as page blobs
* Include and exclude filtering support
* Rsync-like delete support
* No clobber support in either direction
* Automatic content type tagging
* File logging support
* Support for HTTP proxies
## Installation
There are three ways to install `blobxfer`:
* `blobxfer` Python package from [PyPI](https://pypi.python.org/pypi/blobxfer)
* Pre-built binaries available under [Releases](https://github.com/Azure/blobxfer/releases)
* Docker images are available for both Linux and Windows platforms on
[Docker Hub](https://hub.docker.com/r/alfpark/blobxfer/)
Please refer to the
[installation guide](http://blobxfer.readthedocs.io/en/latest/01-installation/)
for more information on how to install `blobxfer`.
## Documentation
Please refer to the [`blobxfer` documentation](http://blobxfer.readthedocs.io/)
for more details and usage information.
## Change Log
Please see the
[Change Log](http://blobxfer.readthedocs.io/en/latest/CHANGELOG/)
for project history.
* * *
Please see this project's [Code of Conduct](CODE_OF_CONDUCT.md) and
[Contributing](CONTRIBUTING.md) guidelines.
[](https://travis-ci.org/Azure/blobxfer)
[](https://ci.appveyor.com/project/alfpark/blobxfer)
[](https://codecov.io/gh/Azure/blobxfer)
[](https://pypi.python.org/pypi/blobxfer)
[](https://hub.docker.com/r/alfpark/blobxfer)
[](http://microbadger.com/images/alfpark/blobxfer)
# blobxfer
`blobxfer` is an advanced data movement tool and library for Azure Storage
Blob and Files. With `blobxfer` you can copy your files into or out of Azure
Storage with the CLI or integrate the `blobxfer` data movement library into
your own Python scripts.
## Major Features
* Command-line interface (CLI) providing data movement capability to and
from Azure Blob and File Storage
* Standalone library for integration with scripts or other Python packages
* High-performance design with asynchronous transfers and disk I/O
* Supports ingress, egress and synchronization of entire directories,
containers and file shares
* YAML configuration driven execution support
* Fine-grained resume support including resuming a broken operation
within a file or object
* Vectored IO support
* `stripe` mode allows striping a single file across multiple blobs (even
to multiple storage accounts) to break through single blob or fileshare
throughput limits
* `replica` mode allows replication of a file across multiple destinations
including to multiple storage accounts
* Synchronous copy with cross-mode (object transform) replication support
(including block-level copies for Block blobs)
* Client-side encryption support
* Support all Azure Blob types and Azure Files for both upload and download
* Advanced skip options for rsync-like operations
* Store/restore POSIX filemode and uid/gid
* Support reading/pipe from `stdin` including to page blob destinations
* Support reading from blob and file share snapshots for downloading and
synchronous copy
* Support for setting access tier on objects for uploading and synchronous
copy
* Configurable one-shot block upload support
* Configurable chunk size for both upload and download
* Automatic block size selection for block blob uploading
* Automatic uploading of VHD/VHDX files as page blobs
* Include and exclude filtering support
* Rsync-like delete support
* No clobber support in either direction
* Automatic content type tagging
* File logging support
* Support for HTTP proxies
## Installation
There are three ways to install `blobxfer`:
* `blobxfer` Python package from [PyPI](https://pypi.python.org/pypi/blobxfer)
* Pre-built binaries available under [Releases](https://github.com/Azure/blobxfer/releases)
* Docker images are available for both Linux and Windows platforms on
[Docker Hub](https://hub.docker.com/r/alfpark/blobxfer/)
Please refer to the
[installation guide](http://blobxfer.readthedocs.io/en/latest/01-installation/)
for more information on how to install `blobxfer`.
## Documentation
Please refer to the [`blobxfer` documentation](http://blobxfer.readthedocs.io/)
for more details and usage information.
## Change Log
Please see the
[Change Log](http://blobxfer.readthedocs.io/en/latest/CHANGELOG/)
for project history.
* * *
Please see this project's [Code of Conduct](CODE_OF_CONDUCT.md) and
[Contributing](CONTRIBUTING.md) guidelines.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
blobxfer-1.5.3.tar.gz
(85.9 kB
view hashes)
Built Distribution
blobxfer-1.5.3-py2.py3-none-any.whl
(119.4 kB
view hashes)
Close
Hashes for blobxfer-1.5.3-py2.py3-none-any.whl
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 77bc170d96ec336cd62b23169233879499a15329fb7ccc570a5b2cbbe8e48557 |
|
| MD5 | b46c559a2d318f38fc8ff2bcb7344051 |
|
| BLAKE2b-256 | ad7b958599d13000ffda13d9eede6d04d3139e05c297622941f1978e752ab2aa |
