Automate

The scientific computational work as portable workflows. Automatically locates the necessary input data and computational resources, and manages storage space for executing data-intensive workflows on storage-constrained resources. Learn more.

Recover

From failures at runtime (fault-tolerance). Task are automatically retried in the presence of errors. A rescue workflow containing a description of only the work that remains is provided. Provenance is also captured (data, software, parameters, etc.). Learn more.

Debug

Failures in computations using a set of system provided debugging tools and an online workflow monitoring dashboard. Learn more.

Highlights from the Blog

Leveraging Pegasus for Integrated Assessment Modeling
with No Comments

In 2016, the Vermont EPSCoR received a $20M award from the National Science Foundation to study and promote resiliency in Lake Champlain Basin. The study aimed at providing much needed information to decision-makers as they govern the basin and develop policies that reach far into the future. A novel computer … Read More

Data Collection and Monitoring Across Heterogeneous Workflows in Pegasus
with No Comments

We will be holding regular online Pegasus Office Hours on Friday April 3rd, 2020 at 11AM Pacific. During this installment of Pegasus Office hours, we will be presenting a data collection pipeline we have developed to enable researchers of the Laser Inferometer Gravitational-Wave Observatory (LIGO) to easily monitor and analyze … Read More

Pegasus 4.9.3 Released
with No Comments

We are happy to announce the release of Pegasus 4.9.3. Pegasus 4.9.3 is a minor bug fix release after Pegasus 4.9.2. This release has support for Singularity Library as a source for pulling singularity containers, in lieu of Singularity HUB.  It also has support for non authenticated ftp to file … Read More

Pegasus Workflows on OLCF Summit
with No Comments

We will be holding regular online Pegasus Office Hours on Friday January 24th, 2020 at 11AM Pacific. This time, we will have an overview presentation of the recent work done to submit Pegasus Workflows on OLCF Summit. OLCF team provides an Openshift/Kubernetes based infrastructure within their DMZ that facilitates access … Read More

Pegasus Research Team Discovers Errors for a Win
with No Comments

Savanna Mesch | January 15, 2020 Team recognized for “transformative contribution” to computing research with surprising discovery At the PEARC19 conference this past summer, researchers at the USC Viterbi School of Engineering won a transformative research award in addition to the best technical paper. The work focused on providing scientists extra assurances that their … Read More

Job Openings
with No Comments

The SciTech group does research and development on software systems to help scientists manage large-scale computations. We work with scientists in domains ranging from genomics and proteomics to seismology and gravitational wave physics. We help scientists deploy their computations on some of the largest and fastest computing systems in the … Read More

Pegasus Workflows on OLCF Summit
with No Comments

Summit is a leadership-class computing system for open science that is hosted at the Oak Ridge National Laboratory. Summit, launched in 2018, delivers 8 times the computational performance of Titan’s 18,688 nodes, using only 4,608 nodes. Its architecture with the associated GPU resources, makes it an attractive resource for scientists … Read More

Pegasus and Dynamo Aiding Weather Scientists
with No Comments

Computational science today depends on many complex, compute and data-intensive applications operating on distributed datasets that originate from a variety of scientific instruments and data repositories. Two major challenges for these applications are (1) the provisioning of compute resources and (2) the integration of data into the scientists’ workflow. Background … Read More