Pegasus: Makes the Work Flow

Automate

The scientific computational work as portable workflows. Automatically locates the necessary input data and computational resources, and manages storage space for executing data-intensive workflows on storage-constrained resources. Learn more.

Recover

From failures at runtime (fault-tolerance). Task are automatically retried in the presence of errors. A rescue workflow containing a description of only the work that remains is provided. Provenance is also captured (data, software, parameters, etc.). Learn more.

Debug

Failures in computations using a set of system provided debugging tools and an online workflow monitoring dashboard. Learn more.

Highlights from the Blog

PUG 2021 Followup
PUG 2021 Followup
by on with No Comments

PUG 2021 was a success! We had great user community engagement throughout the two-day event via Zoom and Slack. Thank you to all those who gave presentations and attended – you have all contributed to the improving Pegasus in more ways than one. In case you missed a session or … Read More

Astronomical Image Processing in the Cloud
Astronomical Image Processing in the Cloud
by on with No Comments

Author: Dino Bektešević, University of Washington, LSST/Rubin Observatory project Overview In 2020 the Data Intensive Research in Astrophysics and Cosmology institute (DIRAC), University of Washington (WA) Astronomy Department, Legacy Survey of Space and Time (LSST) and Amazon Web Services (AWS) joined forces to develop a proof-of-concept (PoC) leveraging cloud resources … Read More

Pegasus and AtlanticWave-SDX Help Orchestrating Science Applications
Pegasus and AtlanticWave-SDX Help Orchestrating Science Applications
by on with No Comments

Pegasus and AtlanticWave-SDX Help Orchestrating Science Applications Authors: Cong Wang (Renaissance Computing Institute), Yufeng Xin (Renaissance Computing Institute), Heidi Morgan (USC – Information Sciences Institute), Julio Ibarra (Florida International University) Many new technologies and new paradigms are emerging in the research community to support science workflows, including the use of … Read More

Pegasus mentions at the OSG All Hands Meeting 2021
Pegasus mentions at the OSG All Hands Meeting 2021
by on with No Comments

As the 2021 Open Science Grid – All Hands Meeting is coming to close, we wanted to bring to attention some interesting Pegasus users and mentions in talks. The meeting opened with the OSG director Frank Würthwein highlighting UNL graduate student Natasha Pavlovikj and her work on ProkEvo. Frank also … Read More

PUG 2021
PUG 2021
by on with No Comments

Pegasus Users Group Meeting 2021 (Feb 23rd and Feb 25th, 2021) 2020 was a busy year for us!   We released Pegasus 5.0 which comes with a brand new Python3 API for creating and managing workflows.  We have big goals for 2021. We are in the midst of planning our … Read More

Pegasus 5.0 Released
Pegasus 5.0 Released
by on with No Comments

We are happy to announce the release of Pegasus 5.0. Pegasus 5.0 is be a major release of Pegasus and builds upon the beta version released couple of months back. It also includes all features and bug fixes from the 4.9 branch. We invite our users to give it a … Read More

Pegasus in 5 Minutes
Pegasus in 5 Minutes
by on with No Comments

In this quick 5 minute presentation, the Pegasus team gives you an introduction into the Pegasus Workflow Management System. We give a rundown on how Pegasus workflows are created, compiled for your execution environment, and then executed on distributed resources.

My Summer Research Internship at SciTech Lab
My Summer Research Internship at SciTech Lab
by on with No Comments

Note the author: Kelsie Lam is a senior at Mission San Jose High School. She is a SciTech research intern interested in artificial intelligence and cognitive science. In the lab, Kelsie investigates how scientists use machine learning methods to support their research and works on developing workflows. Github: https://github.com/kelsielam During … Read More