Create a local pypi repository to use pip off-line
Project description
Create a local pypi repository to use pip off-line.
Minirepo is a command-line program that downloads Python packages from pypi.python.org, so you can use pip without internet. I needed to maintain a python repository in an isolated cluster environment, and after trying several tools to mirror pypi index, I dedided to make my own tool.
Some mirroring tools such us bandersnatch didn’t meet my requirements, because I wanted to do a selective mirror, only downlowing all sources for python 2.7, for example. Bandersnatch gets the full content, about 140GB at the time of my first version of minirepo.
Then I was inspired by basket, which is almost what I wanted, but you need to specify the list of packages to download. I ended up using the json API to get the packages that I needed, and then calling basket to download or update the packages. In the end, that approach was slow and buggy, so I wrote this small program to do what I just needed. Now, my minirepo folder has about 12GB with all the latest packages.
Installation
Use pip
The easiest way to install it is to use pip:
$ pip install minirepoOr download and install
Download the package file from https://pypi.python.org/pypi/minirepo, or the latest development version from https://github.com/sganis/minirepo, then:
$ tar xvzf minirepo-1.0.2.tar.gz
$ cd minirepo-1.0.2
$ python setup.py installYou can also use git:
$ git clone https://github.com/sganis/minirepo.git
$ cd minirepo
$ python setup.py installUsage
# run it from the command line:
$ minirepo
# or run the python script if you didn't install it:
$ ./minirepo.pyThe firt time it’s executed, the program will ask you for the local repository path, which defaults to ~/minirepo in Linux. A json configuration file is created and saved as ~/.minirepo, that you can edit to meet your requirements. This configuration file looks like this:
{
"processes" : 20,
"repository" : "/home/user/minirepo"
"package_types" : ["bdist_egg","bdist_wheel","sdist"],
"extensions" : ["bz2","egg","gz","tgz","whl","zip"],
"python_versions" : ["2.7","any","cp27","py2","py27","source"],
}Minirepo uses packages_types, extensions, and python_versions as filters. I was analysing the full list of packages available in pypi.python.org, and it looks that all the options are something like the list below, you can try any other option. For me, I was only interested in python 2.7 packages, sources, wheels and eegs distributions, and some extensions.
PYTHON_VERSIONS = [
'2', '2.2', '2.3', '2.4', '2.5', '2.6', '2.7', '2.7.6', '3.0', '3.1',
'3.2', '3.3', '3.4', '3.5', 'any', 'cp25', 'cp26', 'cp27', 'cp31',
'cp32', 'cp33', 'cp34', 'cp35', 'py2', 'py2.py3', 'py26', 'py27',
'py3', 'py32, py33, py34', 'py33', 'py34', 'python', 'source'
]
PACKAGE_TYPES = [
'bdist_dmg', 'bdist_dumb', 'bdist_egg', 'bdist_msi', 'bdist_rpm',
'bdist_wheel', 'bdist_wininst', 'sdist'
]
EXTENSIONS = [
'bz2', 'deb', 'dmg', 'egg', 'exe', 'gz', 'msi', 'rpm', 'tgz', 'whl', 'zip'
]TODO
Use pip without internet
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
