Documentation
SOFTWARE REQUIRED TO BUILD FROM SOURCE
- ANT v1.6 or higher
- JAVA v1.5 or higher
- gtar
BUILDING ENSEMBLE FROM SOURCE
- Untar the ensemble-source.*.tar.gz
- Unset CLASSPATH
- Set env ENSEMBLE_HOME=
- Source $ENSEMBLE_HOME/setup-devel.csh or setup-devel.sh
BUILD BINARY Package
- cd $ENSEBLE_HOME
- ant package
Clean build area
- cd $ENSEMBLE_HOME
- ant clean
SOFTWARE REQUIRED TO RUN
- JAVA 1.5+
- PEGASUS 2.1CVS
- CONDOR 6.9.x
- MYSQL
INSTALL ENSEMBLE MANAGER
- Copy the binary tarball built in the earlier step to an installation location and untar it
$ gtar zxvf $ENSEMBLE_HOME/dist/ensemble.tar.gz - Set environment ENSEMBLE_HOME to the untarred directory
export ENSEMBLE_HOME=/usr/local/ensemble - source $ENSEMBLE_HOME/setup.csh or $ENSEMBLE_HOME/setup.csh
Create the Ensemble DB
- As user root create a db for storing the ensemble schema in MySQL
- Add a username and password which has access to this db
- Populate the created Db with the ensemble schema from $ENSMEBLE_HOME/sql/ensemble.sql
Edit the Ensemble configuration file
Edit the $ENSEMBLE_HOME/etc/properties or create a file $HOME/.ensemblerc condor.home=<path to condor install home directory> pegasus.home=<path to pegasus install home directory $PEGASUS_HOME> ensemble.db.url=<jdbc url to ensemble db . e.g. jdbc:mysql://smarty.isi.edu/ensembledb> ensemble.db=MySQL ensemble.db.user=<dbusername> ensemble.db.password=<dbpassword> ensemble.localdir=<path where ensemsble wfls are planned and dags are generated. Default is $ENSEMBLE_HOME/var>
RUNNING ENSEMBLE MANAGER
Please ensure that EM is installed and configured as mentioned in the INSTALL File.
The ensemble input file contains a workflow per line. The format of the file is
WORKFLOW : WORKFLOW TYPE : PRIORITY : STARTIME in MINS : OPTIONAL LABEL
If the workflow type is of type dax then the planner arguments are read from the next line.
E.g. of an ensemble input file
#Comments are written with # /smarty/software/pegasus/default/examples/blackdiamond.dax:DAX:1:20:wf1 --sites viz --output local --force --nocleanup /smarty/software/pegasus/default/examples/blackdiamond.dax:DAX:5:10:wf2 --sites local --output local --force --nocleanup /smarty/test/1.dag:DAG:100:0 /smarty/test/2.dag:DAG:10:200E.g. of ensemble-submit
ensemble-submit -S /home/gmehta/config/sc.xml -P /home/gmehta/config/properties
-f /home/gmehta/ensemble/workflowinput.txt
EnsembleId = d7065da3-421d-47ac-b9aa-9447cf9f231c
WorkflowId = 09523b5a-421d-4cbf-8819-d796b4a09798
WorkflowId = 0e9c2bba-36f6-47ac-9059-1b811b279903
WorkflowId = 3108d383-d83f-4910-b9aa-027c5aa439b7
WorkflowId = 32957769-ee00-468f-9f1a-9447cf9f231c
WorkflowId = 489eb95b-9d76-4808-849a-b75f36eb05e5
WorkflowId = 662001c6-75e3-4e8f-b942-47cca5820645
WorkflowId = 7e13f990-8874-4c70-a4ab-c5d75ce000d4
WorkflowId = 8142a37c-4e5e-468d-b4ac-4060ef4c5d97
WorkflowId = ce19605e-16a0-4d26-a886-31fa791b785a
WorkflowId = d7065da3-dc70-4582-9f6e-8d372bacf980
E.g. of ensemble-status
ensemble-status -e d7065da3-421d-47ac-b9aa-9447cf9f231c
SUBMITTED STARTED PLANNED RUNNING SUCCESS FAILED
0 4 3 2 0 1
ensemble-status -e d7065da3-421d-47ac-b9aa-9447cf9f231c --verbose
Workflow : 09523b5a-421d-4cbf-8819-d796b4a09798 2007-11-14 14:29:03.0 STARTED
Workflow : 0e9c2bba-36f6-47ac-9059-1b811b279903 2007-11-14 14:29:01.0 STARTED
Workflow : 3108d383-d83f-4910-b9aa-027c5aa439b7 2007-11-14 14:29:02.0 STARTED
Workflow : 32957769-ee00-468f-9f1a-9447cf9f231c 2007-11-14 14:30:01.0 PLANNED
Workflow : 489eb95b-9d76-4808-849a-b75f36eb05e5 2007-11-14 14:31:03.0 PLANNED
Workflow : 662001c6-75e3-4e8f-b942-47cca5820645 2007-11-14 14:31:02.0 RUNNING
Workflow : 7e13f990-8874-4c70-a4ab-c5d75ce000d4 2007-11-14 14:31:12.0 RUNNING
Workflow : 8142a37c-4e5e-468d-b4ac-4060ef4c5d97 2007-11-14 14:40:11.0 SUCCESS
Workflow : ce19605e-16a0-4d26-a886-31fa791b785a 2007-11-14 14:40:12.0 SUCCESS
Workflow : d7065da3-dc70-4582-9f6e-8d372bacf980 2007-11-14 14:31:02.0 FAILED
SUBMITTED STARTED PLANNED RUNNING SUCCESS FAILED
0 3 2 2 2 1