A Python Wrapper for the workload model proposed by Lublin

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for trovao from gravatar.com trovao

Unverified details

These details have not been verified by PyPI
Project links
GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Meta

License: MIT License

Author: Renato L. de F. Cunha

Tags workload, standard workload format, swf

Requires: Python >=3.6, <4

Classifiers

Project description

A Python port of the Workload Model proposed by Lublin & Feitelson.

The following code shows how to use it:

from parallelworkloads import lublin99
w = lublin99.Lublin99(1, 2)  # Will use both batch and interactive jobs
w.numJobs=4  # will generate four jobs
w.generate()  # The four generated jobs are shown below

[SwfJob(jobId=1, submissionTime=103, waitTime=-1, runTime=12379,
allocProcs=16, avgCpuUsage=-1, usedMem=-1, reqProcs=-1, reqTime=-1,
reqMem=-1, status=1, userId=-1, groupId=-1, executable=-1, queueNum=1,
partNum=-1, precedingJob=-1, thinkTime=-1),

SwfJob(jobId=2, submissionTime=3089, waitTime=-1, runTime=177,
allocProcs=16, avgCpuUsage=-1, usedMem=-1, reqProcs=-1, reqTime=-1,
reqMem=-1, status=1, userId=-1, groupId=-1, executable=-1, queueNum=1,
partNum=-1, precedingJob=-1, thinkTime=-1),

SwfJob(jobId=3, submissionTime=3150, waitTime=-1, runTime=10, allocProcs=2,
avgCpuUsage=-1, usedMem=-1, reqProcs=-1, reqTime=-1, reqMem=-1, status=1,
userId=-1, groupId=-1, executable=-1, queueNum=0, partNum=-1,
precedingJob=-1, thinkTime=-1),

SwfJob(jobId=4, submissionTime=3172, waitTime=-1, runTime=7,
allocProcs=32, avgCpuUsage=-1, usedMem=-1, reqProcs=-1, reqTime=-1,
reqMem=-1, status=1, userId=-1, groupId=-1, executable=-1, queueNum=0,
partNum=-1, precedingJob=-1, thinkTime=-1)]

User runtime estimates

parallelworkloads also supports generating runtime estimates based on the model proposed by Dan Tsafrir in 2005. For the model to work, it needs at least 200 jobs. Here’s an example continuing the previous one:

from parallelworkloads import tsafrir05

w.numJobs = 200
jobs = w.generate()
print('Original requested time of first job:', jobs[0].reqTime)
t = tsafrir05.Tsafrir05(jobs)
jobs = t.generate(jobs)
print('Generated requested time of first job:', jobs[0].reqTime)

Which gives as output:

Original requested time: -1
Generated requested time: 22962.0

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for trovao from gravatar.com trovao

Unverified details

These details have not been verified by PyPI
Project links
GitHub Statistics

View statistics for this project via Libraries.io, or by using our public dataset on Google BigQuery

Meta

License: MIT License

Author: Renato L. de F. Cunha

Tags workload, standard workload format, swf

Requires: Python >=3.6, <4

Classifiers

Release history Release notifications | RSS feed

This version

0.1.3

0.1.2

0.1.1

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

parallelworkloads-0.1.3.tar.gz (3.2 kB view hashes)

Uploaded Source

Built Distributions

parallelworkloads-0.1.3-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.0 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

parallelworkloads-0.1.3-pp38-pypy38_pp73-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl (1.0 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ i686 manylinux: glibc 2.5+ i686

parallelworkloads-0.1.3-pp38-pypy38_pp73-macosx_10_9_x86_64.whl (213.0 kB view hashes)

Uploaded PyPy macOS 10.9+ x86-64

parallelworkloads-0.1.3-pp37-pypy37_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.0 MB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ x86-64

parallelworkloads-0.1.3-pp37-pypy37_pp73-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl (967.6 kB view hashes)

Uploaded PyPy manylinux: glibc 2.17+ i686 manylinux: glibc 2.5+ i686

parallelworkloads-0.1.3-pp37-pypy37_pp73-macosx_10_9_x86_64.whl (96.3 kB view hashes)

Uploaded PyPy macOS 10.9+ x86-64

parallelworkloads-0.1.3-cp310-cp310-musllinux_1_1_x86_64.whl (1.5 MB view hashes)

Uploaded CPython 3.10 musllinux: musl 1.1+ x86-64

parallelworkloads-0.1.3-cp310-cp310-musllinux_1_1_i686.whl (1.5 MB view hashes)

Uploaded CPython 3.10 musllinux: musl 1.1+ i686

parallelworkloads-0.1.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (930.9 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ x86-64

parallelworkloads-0.1.3-cp310-cp310-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl (890.0 kB view hashes)

Uploaded CPython 3.10 manylinux: glibc 2.17+ i686 manylinux: glibc 2.5+ i686

parallelworkloads-0.1.3-cp310-cp310-macosx_10_9_x86_64.whl (120.2 kB view hashes)

Uploaded CPython 3.10 macOS 10.9+ x86-64

parallelworkloads-0.1.3-cp39-cp39-musllinux_1_1_x86_64.whl (1.5 MB view hashes)

Uploaded CPython 3.9 musllinux: musl 1.1+ x86-64

parallelworkloads-0.1.3-cp39-cp39-musllinux_1_1_i686.whl (1.5 MB view hashes)

Uploaded CPython 3.9 musllinux: musl 1.1+ i686

parallelworkloads-0.1.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (927.9 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ x86-64

parallelworkloads-0.1.3-cp39-cp39-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl (887.0 kB view hashes)

Uploaded CPython 3.9 manylinux: glibc 2.17+ i686 manylinux: glibc 2.5+ i686

parallelworkloads-0.1.3-cp39-cp39-macosx_10_9_x86_64.whl (120.2 kB view hashes)

Uploaded CPython 3.9 macOS 10.9+ x86-64

parallelworkloads-0.1.3-cp38-cp38-musllinux_1_1_x86_64.whl (1.5 MB view hashes)

Uploaded CPython 3.8 musllinux: musl 1.1+ x86-64

parallelworkloads-0.1.3-cp38-cp38-musllinux_1_1_i686.whl (1.5 MB view hashes)

Uploaded CPython 3.8 musllinux: musl 1.1+ i686

parallelworkloads-0.1.3-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (928.0 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ x86-64

parallelworkloads-0.1.3-cp38-cp38-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl (888.2 kB view hashes)

Uploaded CPython 3.8 manylinux: glibc 2.17+ i686 manylinux: glibc 2.5+ i686

parallelworkloads-0.1.3-cp38-cp38-macosx_10_9_x86_64.whl (119.3 kB view hashes)

Uploaded CPython 3.8 macOS 10.9+ x86-64

parallelworkloads-0.1.3-cp37-cp37m-musllinux_1_1_x86_64.whl (1.4 MB view hashes)

Uploaded CPython 3.7m musllinux: musl 1.1+ x86-64

parallelworkloads-0.1.3-cp37-cp37m-musllinux_1_1_i686.whl (1.4 MB view hashes)

Uploaded CPython 3.7m musllinux: musl 1.1+ i686

parallelworkloads-0.1.3-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (889.4 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ x86-64

parallelworkloads-0.1.3-cp37-cp37m-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl (850.5 kB view hashes)

Uploaded CPython 3.7m manylinux: glibc 2.17+ i686 manylinux: glibc 2.5+ i686

parallelworkloads-0.1.3-cp37-cp37m-macosx_10_9_x86_64.whl (119.3 kB view hashes)

Uploaded CPython 3.7m macOS 10.9+ x86-64

parallelworkloads-0.1.3-cp36-cp36m-musllinux_1_1_x86_64.whl (1.4 MB view hashes)

Uploaded CPython 3.6m musllinux: musl 1.1+ x86-64

parallelworkloads-0.1.3-cp36-cp36m-musllinux_1_1_i686.whl (1.4 MB view hashes)

Uploaded CPython 3.6m musllinux: musl 1.1+ i686

parallelworkloads-0.1.3-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (889.6 kB view hashes)

Uploaded CPython 3.6m manylinux: glibc 2.17+ x86-64

parallelworkloads-0.1.3-cp36-cp36m-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl (850.0 kB view hashes)

Uploaded CPython 3.6m manylinux: glibc 2.17+ i686 manylinux: glibc 2.5+ i686

parallelworkloads-0.1.3-cp36-cp36m-macosx_10_9_x86_64.whl (119.5 kB view hashes)

Uploaded CPython 3.6m macOS 10.9+ x86-64

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page