skip to navigation
skip to content

multiproc 1.0.1

Multiprocessing from the command-line


Multiprocessing from the command-line.

Multiproc allows one to use a pool of workers with bash. It provides a
reliable way to launch a lot of concurrent processes while keeping the
control of the number of these processes.

This program uses python3.


Usage: multiproc [-h] [-0] [-v] [-p N] [-1] FORMAT

FORMAT The command to be run in each process.
"%s" input string
"%n" number of the process
"%%" litteral "%"

-h, --help Print this help and exit.
-v, --verbose Set verbose output
-0 Use NUL as delimiter
This doesn't cover potential command output.
-p, --process N Number of processes to be used.
Default is the number of CPU.
-1, --uniq Equivalent to -p1

Example: download multiple files where urls.txt contains the urls list

$ cat urls.txt | multiproc -p 10 "wget %s -O file.%n"


Download multiple files where urls.txt contains the urls list with 10 processes:

$ cat urls.txt | multiproc -p 10 "wget %s -O file.%n"

Work with files

$ find . -iname "*.c" -print0 | multiproc -v -0 "gcc %n"


The easiest is

pip install multiproc

or, in this directory

python3 setup install


docopt or "pip install docopt"


This program is under the GPLv3 License.

You should have received a copy of the GNU General Public License
along with this program. If not, see <http:"" licenses=""/>.


Main developper: Cédric Picard
Twitter: @Cym13
GPG: 383A 76B9 D68D 2BD6 9D2B 4716 E3B9 F4FE 5CED 42CB
File Type Py Version Uploaded on Size
multiproc-1.0.1.tar.gz (md5) Source 2014-06-13 3KB