Astronomical Image Processing in the Cloud

with No Comments

Author: Dino Bektešević, University of Washington, LSST/Rubin Observatory project Overview In 2020 the Data Intensive Research in Astrophysics and Cosmology institute (DIRAC), University of Washington (WA) Astronomy Department, Legacy Survey of Space and Time (LSST) and Amazon Web Services (AWS) joined forces to develop a proof-of-concept (PoC) leveraging cloud resources … Read More

Pegasus and AtlanticWave-SDX Help Orchestrating Science Applications

with No Comments

Many new technologies and new paradigms are emerging in the research community to support science workflows, including the use of Data Transfer Nodes (DTNs), distributed compute and data infrastructure, research testbeds, and new inter-domain federated orchestrators. Workflow management systems (WMS), like Pegasus, are evolving to be more resource aware in … Read More

Pegasus and Dynamo Aiding Weather Scientists

with No Comments

Computational science today depends on many complex, compute and data-intensive applications operating on distributed datasets that originate from a variety of scientific instruments and data repositories. Two major challenges for these applications are (1) the provisioning of compute resources and (2) the integration of data into the scientists’ workflow. Background … Read More

Pegasus 4.5.1 Released

with No Comments

  We are happy to annouce the release of Pegasus 4.5.1. Pegasus 4.5.1 is a minor release, which contains minor enhancements and fixes bugs in the Pegasus 4.5.0 release. Enhancements pegasus-statistics reports workflow badput pegasus-statistics now reports the workflow badput time, which is the sum of all failed kickstart jobs. … Read More