Pegasus Timeline
Release 4.9.0
– Integrity Checking
– AWS Batch
– Pegasus Tutorial With Containers
Release 4.8.5
– Fixed bugs for singularity support and planning in shared filesystem
Release 4.8.4
– Integration with OSG gratia
– fixed bugs for SLURM submission, python dependencies, and pegasus properties and monitord
Release 4.8.3
– Container based example in pegasus-init
– Ability to run container tutorials in the VM
Release 4.8.2
– Improved pegasus-analyzer to show location of submit file
– Updated tutorials to account for the SLURM upgrade
Release 4.8.1
– Updated pyOpenSSL version
– Bug fixes including improvements to hierarchical workflow support
Release 4.8.0
– Application Containers (Docker and Singularity)
– Jupyter Support (Python API)
– Tuning of Transfer and Cleanup jobs
Release 4.7.3
– Dashboard displays errors if a job is killed instead of exiting with non zero exitcode
– Dashboard displays database and Pegasus version
– Pegasus dashboard pie charts distinguishes between running and unsubmitted jobs
Pegasus 4.7.2
– Fixed bugs for pegasus-transfer and PegasusLite
Pegasus 4.7.1
– Capture the execution site information in pegasus-lite
– Added ability to check CVMFS for worker package
Pegasus 4.7.0
– Automated submit directory organization
– Improved directory management on staging site in nonsharedfs mode
– R DAX API and examples with pegasus-init
– pegasus-analyzer reports information about held jobs
– Automated check for cyclic dependencies in the DAG
Pegasus 4.6.2
– Support for kickstart wrappers that can setup a user environment
– Support for Cobalt and SLURM schedulers via the Glite interfaces
– Ability to do local copy of files in PegasusLite to staging site (if the compute and staging site are the same)
– Support for setting up Pegasus Tutorial on Bluewaters using pegasus-init
Pegasus 4.6.1
– Support for MOAB submissions via glite. A new tool called pegasus-configure-glite helps users setup their HTCondor GLite directory for use with Pegasus
– pegasus-s3 now allows for downloading and uploading folders to and from Amazon S3
– Initial support for Globus Online in pegasus-transfer
– Planner automatically copies the user catalog files into a directory called catalogs in the submit directory
– Changes to how worker package staging occurs for compute jobs
Pegasus 4.6.0
– Metadata support
– Support for variable substitution
– Constraints based cleanup algorithm
– Common Pegasus profiles to specify task requirements
– New command line client pegasus-init to configure Pegasus, and pegasus-metadata to query workflow database for metadata
– Support for fallback PFN’s
Pegasus 4.5.4
– Planner reports information of options used in the planner
– pegasus-submitdir provides undelete or attach/detach commands
– pegasus-monitord parses new DAGMan output that reports timestamps from HTCondor user log
– pegasus-analyzer now detects if a workflow failed to start because of DAGMan failure on NFS error setting, and also displays any errors in *.dag.lib.err file
Pegasus 4.5.3
– Separate input and output replica catalog
– Show DAX/DAG planning jobs in Failed/Succesfull/Running/Failing tabs in the dashboard
– Data reuse algorithm considers file locations while cascading deletion upwards
Pegasus 4.5.2
– File locations in the DAX treated as a Replica Catalog
– Pegasus auxillary tools now have support for iRods 4.x
Pegasus 4.5.0
– Ensemble manager for managing collections of workflows
– Support for job checkpoint files
– Support for Google Cloud Storage
– Improvements to pegasus-dashboard
– Data management improvements
– New tools: pegasus-db-admin, pegasus-submitdir, pegasus-halt, and pegasus-graphviz
Release 3.0.1
– Updates to Pegasus VM Tutorial
– pegasus-plots improvements
Release 3.0
– New DAX Schema Version 3.2
– Shell Code Generator
– New tools called pegasus-statistics and pegasus-plots
– Support for GT5
–
16,940 views