Workflow Management System

Automate, recover, and debug scientific computations.

Automate

The scientific computational work as portable workflows. Automatically locates the necessary input data and computational resources, and manages storage space for executing data-intensive workflows on storage-constrained resources. Learn more.

Recover

From failures at runtime (fault-tolerance). Task are automatically retried in the presence of errors. A rescue workflow containing a description of only the work that remains is provided. Provenance is also captured (data, software, parameters, etc.). Learn more.

Debug

Failures in computations using a set of system provided debugging tools and an online workflow monitoring dashboard. Learn more.

Highlights from the Blog

Job Opening: Postdoctoral Scholar – Research Associate
Job Opening: Postdoctoral Scholar – Research Associate
by on with No Comments

The SciTech group does research and development on software systems to help scientists manage large-scale computations. We work with scientists in domains ranging from genomics and proteomics to seismology and gravitational wave physics. We help scientists deploy their computations on some of the largest and fastest computing systems in the … Read More

Pegasus on the Open Science Grid
Pegasus on the Open Science Grid
by on with No Comments

We will be holding regular online Pegasus Office Hours this Friday October 12th at 11AM Pacific. For this series, we will have an overview presentation on Pegasus on the Open Science Grid. Topics include: How to run Pegasus workflows in the execution environment provided by OSG Connect. Using StashCache for … Read More

Pegasus 4.8.4 Released
Pegasus 4.8.4 Released
by on with No Comments

We are happy to announce the release of Pegasus 4.8.4 . Pegasus 4.8.4 is a minor bug fix release. Improvements [PM-1294] – update flask dependency [PM-1277] – pegasus workflows on OSG should appear in OSG gratia [PM-1288] – pegasus.project profile key is not set for SLURM submissions Bugs Fixed [PM-1282] … Read More

NSF OAC Webinar Series: Science Impact of Sustained Cyberinfrastructure: The Pegasus Example
NSF OAC Webinar Series: Science Impact of Sustained Cyberinfrastructure: The Pegasus Example
by on with No Comments

Dr. Deelman was invited to kick off the National Science Foundation (NSF) Office of Advanced Cyberinfrastructure (OAC) 2018 monthly webinar series.   OAC – CI Webinar Series Theme and Purpose: The 2018 webinar series will focus on the translational impact of Advanced Cyberinfrastructure and will highlight how cyberinfrastructure innovations have … Read More

Pegasus in the Sky with Data
Pegasus in the Sky with Data
by on with No Comments

Pegasus and Ewa Deelman were recently featured in the USC Viterbi School of Engineering magazine. We hope you enjoy the story of Pegasus’ creation and successes as much as we do.    

Pegasus related talks and topics at the 2018 OSG All Hands Meeting
Pegasus related talks and topics at the 2018 OSG All Hands Meeting
by on with No Comments

Last week, Open Science Grid held its annual All Hands Meeting, this time hosted by University of Utah. It was a pleasure to meet Pegasus users and see their talks. A big thank you to those projects and presenters, for sharing their experiences and continued use of Pegasus. Here are … Read More

CyVerse Container Camp
CyVerse Container Camp
by on with No Comments

Pegasus team members will be giving an overview of how to use containers in Pegasus workflows, at the CyVerse Container Camp, March 7-9 at University of Arizona, Tucson. The Pegasus portion is currently scheduled for Friday, but the rest of the agenda is packed with related and interesting topics such … Read More

Pegasus Contributed to New Gravitational-Wave Detector Discovery
Pegasus Contributed to New Gravitational-Wave Detector Discovery
by on with No Comments

  A collaboration that began 16 years ago between computer scientists at the USC Information Sciences Institute (ISI) and members of the Laser Interferometer Gravitational-Wave Observatory (LIGO) and Virgo projects is opening up a new window onto the nature of the universe. Pegasus, a specialized computer program developed by a … Read More