Skip to main content

P* Pilot-Job Implementation based on SAGA-Python

Project description

BigJob
=============

The SAGA BigJob framework is a SAGA-based pilot job implementation. The Simple API for Grid Applications (SAGA) is a high-level, easy-to-use API for accessing distributed resources. SAGA BigJob supports a wide range of application types, and is usable over a broad range of infrastructures, i.e., it is general-purpose, extensible and interoperable. Unlike other common pilot job systems SAGA BigJob
(i) natively supports MPI job and
(ii) works on a variety of back-end systems, generally reflecting the advantage of using a SAGA-based approach.



Web Page & Mailing List
-----------------------

Web page: <http://saga-project.github.io/BigJob/>

Mailing list:

[bigjob-user@googlegroups.com](http://groups.google.com/group/bigjob-users)

[bigjob-devel@googlegroups.com](http://groups.google.com/group/bigjob-devel)


Installation
-------------

curlhttps://raw.github.com/sagaproject/BigJob/master/bootstrap/bigjobbootstrap.pyobigjobbootstrap.py python bigjob-bootstrap.py HOME/.bigjob/python/ . HOME/.bigjob/python/bin/activateSeehttps://github.com/sagaproject/BigJob/wiki/forfurtherinformation.TheWikiincludesamongmanythingsinformationonhowtosetupBigJobonvariousmachines,e.g.onXSEDE(Ranger,Kraken)orFutureGrid.ConfigurationofRedisCoordinationBackendBigJobrequires[Redis](http://redis.io)forcommunicationbetweenBigJobmanager/agent.UsethefollowingstepstoinstallRedis.MacHomebrew:brewinstallredisredistoolsLinux:DownloadRedishttp://redis.io/downloadCurrentlyonlytestedwithRedis2.2.12 tar -xzvf redis-2.2.12.tar.gz
cdredis2.2.12 make
$ make install (if root)


Start Redis (redis-server executable is located in src/ dir):

cd src
./redis-server

Examples:
-------------------------------------

<https://github.com/saga-project/BigJob/tree/master/examples/pilot-api>

Please modify COORDINATION_URL on top of example to the correct Redis backend!

Development & Packaging
-------------------------------------

Requirements:

* setuptools >0.6c11, http://pypi.python.org/pypi/setuptools

* setuptools-git >0.3.3, http://pypi.python.org/pypi/setuptools-git/

Building PyPi package

python setup.py build

Upload to PyPi

python setup.py sdist upload

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page