Automate

The scientific computational work as portable workflows. Automatically locates the necessary input data and computational resources, and manages storage space for executing data-intensive workflows on storage-constrained resources. Learn more.

Recover

From failures at runtime (fault-tolerance). Task are automatically retried in the presence of errors. A rescue workflow containing a description of only the work that remains is provided. Provenance is also captured (data, software, parameters, etc.). Learn more.

Debug

Failures in computations using a set of system provided debugging tools and an online workflow monitoring dashboard. Learn more.

Highlights from the Blog

Predicting Flash Floods in the Dallas-Fort Worth Metroplex Using Pegasus
with No Comments

Authors: Eric Lyons (University of Massachusetts at Amherst), Dong-Jun Seo (University of Texas Arlington), Sunghee Kim (University of Texas Arlington), Hamideh Habibi (University of Texas Arlington), George Papadimitriou (USC – Information Sciences Institute), Ryan Tanaka (USC – Information Sciences Institute) Research Distributed Hydrologic Model A collaborative effort of several National … Read More

PUG 2021 Followup
with No Comments

PUG 2021 was a success! We had great user community engagement throughout the two-day event via Zoom and Slack. Thank you to all those who gave presentations and attended – you have all contributed to the improving Pegasus in more ways than one. In case you missed a session or … Read More

Astronomical Image Processing in the Cloud
with No Comments

Author: Dino Bektešević, University of Washington, LSST/Rubin Observatory project Overview In 2020 the Data Intensive Research in Astrophysics and Cosmology institute (DIRAC), University of Washington (WA) Astronomy Department, Legacy Survey of Space and Time (LSST) and Amazon Web Services (AWS) joined forces to develop a proof-of-concept (PoC) leveraging cloud resources … Read More

Pegasus and AtlanticWave-SDX Help Orchestrating Science Applications
with No Comments

Many new technologies and new paradigms are emerging in the research community to support science workflows, including the use of Data Transfer Nodes (DTNs), distributed compute and data infrastructure, research testbeds, and new inter-domain federated orchestrators. Workflow management systems (WMS), like Pegasus, are evolving to be more resource aware in … Read More

Pegasus mentions at the OSG All Hands Meeting 2021
with No Comments

As the 2021 Open Science Grid – All Hands Meeting is coming to close, we wanted to bring to attention some interesting Pegasus users and mentions in talks. The meeting opened with the OSG director Frank Würthwein highlighting UNL graduate student Natasha Pavlovikj and her work on ProkEvo. Frank also … Read More

PUG 2021
with No Comments

Pegasus Users Group Meeting 2021 (Feb 23rd and Feb 25th, 2021) 2020 was a busy year for us!   We released Pegasus 5.0 which comes with a brand new Python3 API for creating and managing workflows.  We have big goals for 2021. We are in the midst of planning our … Read More

Pegasus 5.0 Released
with No Comments

We are happy to announce the release of Pegasus 5.0. Pegasus 5.0 is be a major release of Pegasus and builds upon the beta version released couple of months back. It also includes all features and bug fixes from the 4.9 branch. We invite our users to give it a … Read More

Pegasus in 5 Minutes
with No Comments

In this quick 5 minute presentation, the Pegasus team gives you an introduction into the Pegasus Workflow Management System. We give a rundown on how Pegasus workflows are created, compiled for your execution environment, and then executed on distributed resources.