Pegasus WMS – Automate, recover, and debug scientific computations

The Pegasus team is very happy to hear about LIGO’s incredible discovery: the first detection of gravitational waves from colliding black holes. We congratulate the entire LIGO Scientific Collaboration and the Virgo Collaboration on this incredible achievement.

frame0320 — 0.2 Second before the black holes collide. Image credit: SXS/LIGO

The Pegasus team is very pleased to have contributed to LIGO’s software infrastructure. One of the main analysis pipelines used by LIGO to detect the gravitational wave was executed using Pegasus Workflow Management System (WMS). The PyCBC analysis pipeline analyzed data from the two LIGO detectors. Initially the analysis was managed by Pegasus WMS on the LIGO Data Grid. LIGO extended their computations to the nation-wide cyber-infrastructures, Open Science Grid and XSEDE. Pegasus aided this expansion by managing cross-site data transfers and computations in a reliable, scalable, and efficient manner. Pegasus enables LIGO researchers to easily monitor and analyze their workflows via a web based dashboard, and a suite of command line tools.

Additional Information:

Water is seen as small red and white molecules on large nanodiamond spheres.(Image credit: Michael Mattheson, OLCF, ORNL)

The Pegasus team is very happy to hear about the cutting-edge research and development that can help solve some of the challenges associated with drug delivery discovery: “The motions of a tRNA (or transfer RNA) model system can be enhanced when coupled with nanodiamonds, or diamond nanoparticles approximately 5 to 10 nanometers in size”. The discovery involved ORNL's Spallation Neutron Source, which provides the most intense pulsed neutron beams in the world for scientific research and industrial development, and ORNL's Titan supercomputer, the nation's most powerful for open science. By comparing the SNS neutron scattering data with the data from the team's molecular dynamics simulations on Titan, the researchers have confirmed that nanodiamonds enhance the dynamics of tRNA when in the presence of water; This analysis was performed with the Pegasus WMS.

Highlights from the Blog

My Summer Research Internship at SciTech Lab

by Rafael Ferreira da Silva on September 11, 2020 with No Comments

Note the author: Kelsie Lam is a senior at Mission San Jose High School. She is a SciTech research intern interested in artificial intelligence and cognitive science. In the lab, Kelsie investigates how scientists use machine learning methods to support their research and works on developing workflows. Github: https://github.com/kelsielam During … Read More

Pegasus 5.0 Preview (Office Hours)

by Karan Vahi on August 3, 2020 with No Comments

We will be holding regular online Pegasus Office Hours on Friday August 7th, 2020 at 11AM Pacific. This time in the office hours, we give a preview of all the great features coming your way in Pegasus 5.0. The office hours will be a combination of presentation and overview of … Read More

Pegasus 5.0 Beta1 Released

by Karan Vahi on July 27, 2020 with 1 Comment

We are happy to announce the beta1 release of Pegasus 5.0. Pegasus 5.0 will be a major release of pegasus and this beta version has most of the features and bug fixes that will be in 5.0. We invite our users to give it a try. Since this is a … Read More

Leveraging Pegasus for Integrated Assessment Modeling

by Rafael Ferreira da Silva on April 2, 2020 with No Comments

In 2016, Vermont EPSCoR received a $20M award from the National Science Foundation to study and promote resiliency in Lake Champlain Basin. The study aims to provide much needed information to decision-makers as they govern the basin and develop policies that reach far into the future. A novel computer model … Read More

Data Collection and Monitoring Across Heterogeneous Workflows in Pegasus

by Karan Vahi on March 27, 2020 with No Comments

We will be holding regular online Pegasus Office Hours on Friday April 3rd, 2020 at 11AM Pacific. During this installment of Pegasus Office hours, we will be presenting a data collection pipeline we have developed to enable researchers of the Laser Inferometer Gravitational-Wave Observatory (LIGO) to easily monitor and analyze … Read More

Pegasus 4.9.3 Released

by Karan Vahi on January 31, 2020 with No Comments

We are happy to announce the release of Pegasus 4.9.3. Pegasus 4.9.3 is a minor bug fix release after Pegasus 4.9.2. This release has support for Singularity Library as a source for pulling singularity containers, in lieu of Singularity HUB. It also has support for non authenticated ftp to file … Read More

Pegasus Workflows on OLCF Summit

by George Papadimitriou on January 22, 2020 with No Comments

We will be holding regular online Pegasus Office Hours on Friday January 24th, 2020 at 11AM Pacific. This time, we will have an overview presentation of the recent work done to submit Pegasus Workflows on OLCF Summit. OLCF team provides an Openshift/Kubernetes based infrastructure within their DMZ that facilitates access … Read More

Pegasus Research Team Discovers Errors for a Win

by Mats Rynge on January 16, 2020 with No Comments

Savanna Mesch | January 15, 2020 Team recognized for “transformative contribution” to computing research with surprising discovery At the PEARC19 conference this past summer, researchers at the USC Viterbi School of Engineering won a transformative research award in addition to the best technical paper. The work focused on providing scientists extra assurances that their … Read More

Workflow Management System

Automate

Recover

Debug

Download.Run.Analyze

Try workflow examples and the tutorial

Pegasus powers LIGO gravitational wave detection analysis

Diamonds that Deliver!