We are happy to announce the release of Pegasus 4.6.1. Pegasus 4.6.1 is a minor release of Pegasus and includes improvements and bug fixes to the 4.6.0 release New features and Improvements in 4.6.1 are support for MOAB submissions via glite. A new tool called pegasus-configure-glite helps users setup their HTCondor GLite directory for … Read More
the scientific computational work as portable workflows. Automatically locates the necessary input data and computational resources, and manages storage space for executing data-intensive workflows on storage-constrained resources. Learn more.
from failures at runtime. Task are automatically retried in the presence of errors. A rescue workflow containing a description of only the work that remains is provided. Provenance is also captured (data, software, parameters, etc.). Learn more.
Pegasus powers LIGO gravitational wave detection analysis
The Pegasus team is very happy to hear about LIGO’s incredible discovery: the first detection of gravitational waves from colliding black holes. We congratulate the entire LIGO Scientific Collaboration and the Virgo Collaboration on this incredible achievement.
The Pegasus team is very pleased to have contributed to LIGO’s software infrastructure. One of the main analysis pipelines used by LIGO to detect the gravitational wave was executed using Pegasus Workflow Management System (WMS). The PyCBC analysis pipeline analyzed data from the two LIGO detectors. Initially the analysis was managed by Pegasus WMS on the LIGO Data Grid. LIGO extended their computations to the nation-wide cyber-infrastructures, Open Science Grid and XSEDE. Pegasus aided this expansion by managing cross-site data transfers and computations in a reliable, scalable, and efficient manner. Pegasus enables LIGO researchers to easily monitor and analyze their workflows via a web based dashboard, and a suite of command line tools.
"We use large, complex workflows to search for gravitational waves with LIGO. Pegasus makes it faster and simpler to run our codes, which lets us concentrate on the new discoveries and new science." explains Dr. Duncan Brown, a physicist at Syracuse University.
Pegasus WMS is a collaboration between the Science Automation Technologies Group at the University of Southern California's Information Sciences Institute and the HTCondor group at the University of Wisconsin, Madison. Pegasus’ collaboration with LIGO dates back to 2001. The workflow technologies that underlie the PyCBC search were first described in the book "Workflows for eScience" co-edited by ISI's Ewa Deelman.
Thanks to the National Science Foundation we have been able to sustain our collaboration for over 15 years, most recently through a joint NSF Data Infrastructure Building Blocks (DIBBS ACI-1443047) award and a Software Infrastructure for Sustained Innovation ( SI2-SSI ACI-1148515 ) award.
Pegasus over the years has received funding from the National Science Foundation through the following grants: SI2-SSI ACI-1148515, ACI-1443047, ACI-0943705, and ACI-0722019. Research in Pegasus workflow performance modeling is supported by the Department of Energy through DE-SC0012636.
Links to more information:
- LIGO press release
- Workflow details
- Gravitational Wave Group at Syracuse University Announcement
- LIGO Detection Paper on Gravitational Waves: Observation of Gravitational Waves from a Binary Black Hole Merger
- KPCC: Caltech wasn’t the only SoCal school helping discover gravitational waves
Highlights from the Blog
Time: 2pm-5pm Date: Tuesday, March 22nd, 2016 Location: Aresty Auditorium at Health Sciences Campus Instructor: The Pegasus team from Viterbi’s Information Sciences Institute Registration: https://uscits.az1.qualtrics.com/SE/?SID=SV_8p7zWppguSYbXKJ Course Material: https://pegasus.isi.edu/tutorial/usc/ The Pegasus Team is hosting a half day workshop on March 22nd, 2016 at the Health Science Campus. This workshop includes a … Read More
Early this month, the Pegasus team was very excited to hear about LIGO’s incredible discovery: the first detection of gravitational waves from colliding black holes. Since then, LIGO and Pegasus have been featured in several media channels. Below, we summarize some of these publications. Additionally, we provide the link to … Read More
While recently gathering data for the Pegasus Annual Report, we reached out to our collaborators at SCEC to summarize how Pegasus WMS impacted their science in 2015. Some interesting facts about SCEC Cybershake Study 15.4 performed by SCEC in 2015 using Pegasus Calculations were distributed between the NSF Track 1 system NCSA Blue … Read More
The Pegasus team is very happy to hear about LIGO’s incredible discovery: the first detection of gravitational waves from colliding black holes. We congratulate the entire LIGO Scientific Collaboration and the Virgo Collaboration on this incredible achievement. The Pegasus team is very pleased to have contributed to LIGO’s … Read More
We are happy to announce the release of Pegasus 4.5.4. Pegasus 4.5.4 is a minor release, which contains minor enhancements and fixes bugs. This will most likely be the last release in the 4.5 series, and unless you have specific reasons to stay with the 4.5.x series, we recommend to … Read More
Last week, UNL HCC and OSG User Support hosted a OSG Software Carpentry workshop at University of Nebraska, Lincoln. The workshop material included Python, Git, distributed high throughput computing, and of course Pegasus! The material for the workshop can be found at: http://swc-osg-workshop.github.io/2016-01-06-UNL/ Even though the Pegasus module is only … Read More
Are you going to the XSEDE’15 conference and want to learn more about Pegasus? Tutorial: Introduction to Scientific Workflow Technologies on XSEDE(link) Poster: Pegasus WMS: Enabling Large Scale Workflows on National Cyberinfrastructure (link) Poster: Next Generation Resequencing of Soybean Germplasm for Trait Discovery on XSEDE using iPlant Infrastructure and Pegasus Workflows We will also be … Read More