Publications

General Pegasus

2008

Adaptive Workflow Processing and Execution in Pegasus K.Lee, N. W. Paton, R. Sakellariou, E. Deelman, A. A. A. Fernandes, G. Mehta, 3rd International Workshop on Workflow Management and Applications in Grid Environments (WaGe08), in Proceedings of the Third International Conference on Grid and Pervasive Computing Symposia/Workshops, Pages 99-106, ISBN 978-0-7695-3177-9, May 25-28 2008, Kunming, China.

2007

Examining the Challenges of Scientific Workflows Gil, Y.; Deelman, E.; Ellisman, M.; Fahringer, T.; Fox, G.; Gannon, D.; Goble, C.; Livny, M.; Moreau, L.; Myers, J. - Computer , Vol.40, no.12, pp.24-32, Dec. 2007

Connecting Scientific Data to Scientific Experiments with Provenance Simon Miles, Ewa Deelman, Paul Groth, Karan Vahi, Gaurang Mehta, Luc Moreau. To appear in Proceedings of Third IEEE International Conference on e-Science and Grid Computing (e-Science 2007) to be held 10-13 December 2007 in Bangalore, India.

Provenance Trails in the Wings/Pegasus Workflow System, Jihie Kim, Ewa Deelman, Yolanda Gil, Gaurang Mehta, Varun Ratnakar. To appear in Concurrency and Computation: Practice and Experience, Special Issue on the First Provenance Challenge, 2007.

Data Placement for Scientific Applications in Distributed Environments, Ann Chervenak, Ewa Deelman, Miron Livny, Mei-Hui Su, Rob Schuler, Shishir Bharathi, Gaurang Mehta, Karan Vahi, to appear in Proceedings of Grid Conference 2007, Austin, Texas, September 2007.

Optimizing Workflow Data Footprint Gurmeet Singh, Karan Vahi, Arun Ramakrishnan, Gaurang Mehta, Ewa Deelman, Henan Zhao, Rizos Sakellariou,Kent Blackburn, Duncan Brown, Stephen Fairhurst, David Meyers, G. Bruce Berriman. To appear in the Special issue of the Scientific Programming Journal dedicated to Dynamic Computational Workflows: Discovery, Optimisation and Scheduling, 2007.

Wings for Pegasus: Creating Large-Scale Scientific Applications Using Semantic Representations of Computational Workflows, Yolanda Gil, Varun Ratnakar, Ewa Deelman, Gaurang Mehta, and Jihie Kim. Proceedings of the 19th Annual Conference on Innovative Applications of Artificial Intelligence (IAAI), Vancouver, British Columbia, Canada, July 22-26, 2007

Integrating Existing Scientific Workflow Systems: The Kepler/Pegasus Example, Nandita Mandal, Ewa Deelman, Gaurang Mehta, Mei-Hui Su, and Karan Vahi, Proceedings of the Second Workshop on Workflows in Support of Large-Scale Science (WORKS'07), in conjunction with the IEEE International Symposium on High Performance Distributed Computing Monterrey, CA, June 2007

"Scheduling Data-Intensive Workflows onto Storage-Constrained Distributed Resources", Arun Ramakrishnan, Gurmeet Singh, Henan Zhao, Ewa Deelman, Rizos Sakellariou, Karan Vahi, Kent Blackburn , David Meyers and Michael Samidi. Seventh IEEE International Symposium on Cluster Computing and the Grid - CCGrid 2007

2006

"Kickstarting Remote Applications", Jens Voeckler, Gaurang Mehta, Yong Zhao, Ewa Deelman, Mike Wilde. Presented at GCE06 Second International Workshop on Grid Computing Environments Tampa Florida.

"Managing Large-Scale Scientific Workflows in Distributed Environments: Experiences and Challenges", Ewa Deelman, Yolanda Gil. Workflows in e-Science, e-Science 2006, Amsterdam, December 4-6, 2006

"Application-level Resource Provisioning on the Grid", Gurmeet Singh, Carl Kesselman, Ewa Deelman. e-Science 2006, Amsterdam, December 4-6, 2006

Enabling Parallel Scientific Applications with Workflow Tools A. Lathers, M.-H. Su, A. Kulungowski, A. W. Lin, G. Mehta, S. T. Peltier, Ewa Deelman, and M. H. Ellisman, Proceedings of Challenges of Large Applications in Distributed Environments (CLADE), Paris, 2006.

2005

"Pegasus: a Framework for Mapping Complex Scientific Workflows onto Distributed Systems" Ewa Deelman, Gurmeet Singh, Mei-Hui Su, James Blythe, Yolanda Gil, Carl Kesselman, Gaurang Mehta, Karan Vahi, G. Bruce Berriman, John Good, Anastasia Laity, Joseph C. Jacob, Daniel S. Katz. Scientific Programming Journal, Vol 13(3), 2005, Pages 219-237

"Simplifying construction of complex workflows for non-expert users of the Southern California Earthquake Center Community Modeling Environment" Philip Maechling, Hans Chalupsky, Maureen Dougherty, Ewa Deelman, Yolanda Gil, Sridhar Gullapalli, Vipin Gupta, Carl Kesselman, Jihie Kim, Gaurang Mehta, Brian Mendenhall, Thomas A. Russ, Gurmeet Singh, Marc Spraragen, Garrick Staples, Karan Vahi. SIGMOD Record 34(3): 24-30 (2005)

"Task Scheduling Strategies for Workflow-based Applications in Grids" J Blythe, S Jain, E Deelman, Y Gil, K Vahi, A Mandal,K Kennedy, CCGrid 2005, Cardiff, UK

"Optimizing Grid-Based Workflow Execution" Gurmeet Singh,Carl Kesselman, Ewa Deelman, Journal of Grid Computing, Volume 3(3-4), December 2005, Pages 201-219

"The Pegasus Portal: Web Based Grid Computing" G Singh, E Deelman, G Mehta, K Vahi, Mei Su, B. Berriman, J Good, J Jacob, D Katz, A Lazzarini, K Blackburn, S Koranda, The 20th Annual ACM Symposium on Applied Computing, Santa Fe, New Mexico, March 13 -17, 2005

2004

Pegasus : Mapping Scientific Workflows onto the Grid Ewa Deelman, James Blythe, Yolanda Gil, Carl Kesselman, Gaurang Mehta, Sonal Patil, Mei-Hui Su, Karan Vahi, Miron Livny, Across Grids Conference 2004, Nicosia, Cyprus

2003

Pegasus and the Pulsar Search: From Metadata to Execution on the Grid. Ewa Deelman, James Blythe, Yolanda Gil, Carl Kesselman, Scott Koranda, Albert Lazzarini, Gaurang Mehta, Maria Alessandra Papa, Karan Vahi, Applications Grid Workshop, PPAM 2003, Czestochowa, Poland 2003.

Workflow Management in GriPhyN Ewa Deelman, James Blythe, Yolanda Gil, and Carl Kesselman, in Grid Resource Management, J. Nabrzyski, J. Schopf, and J. Weglarz editors, Kluwer,  2003.

Mapping Abstract Complex Workflows onto Grid Environments Ewa Deelman, James Blythe, Yolanda Gil, Carl Kesselman, Gaurang Mehta, Karan Vahi, Kent Blackburn, Albert Lazzarini, Adam Arbree, Richard Cavanaugh, and Scott Koranda, Journal of Grid Computing, Vol.1, no. 1, 2003, pp. 25-39.

Using AI Techniques for Workflow Mapping

Artificial Intelligence and Grids: Workflow Planning and Beyond Yolanda Gil, Ewa Deelman, Jim Blythe, Carl Kesselman, and Hongsuda Tangmurarunkit. IEEE Intelligent Systems, January 2004

Transparent Grid Computing: a Knowledge-Based Approach Jim Blythe, Ewa Deelman, Yolanda Gil, Carl Kesselman, IAAI 2003

The Role of Planning in Grid Computing Jim Blythe, Ewa Deelman, Yolanda Gil, Carl Kesselman, Amit Agarwal, Gaurang Mehta, Karan Vahi, ICAPS 2003

Planning for workflow construction and maintenance on the Grid Jim Blythe, Ewa Deelman, Yolanda Gil, ICAPS 2003 Workshop on Planning for Web Services.

Pegasus: Planning for Execution in Grids Ewa Deelman, James Blythe, Yolanda Gil, Carl Kesselman, GriPhyN technical report 2002-20

From Metadata to Execution on the Grid Pegasus and the Pulsar Search Ewa Deelman James Blythe Yolanda Gil Carl Kesselman Gaurang Mehta Karan Vahi, Scott Koranda, Albert Lazzarini, Maria Alessandra Papa, GriPhyN technical report 2003-15

Papers on Applications Using Pegasus

"Managing Large-Scale Workflow Execution from Resource Provisioning to Provenance tracking: The CyberShake Example", Ewa Deelman, Scott Callaghan, Edward Field, Hunter Francoeur, Robert Graves, Nitin Gupta, Vipin Gupta, Thomas H. Jordan, Carl Kesselman, Philip Maechling, John Mehringer, Gaurang Mehta, David Okaya, Karan Vahi, Li Zhao. e-Science 2006, Amsterdam, December 4-6, 2006 : BEST PAPER AWARD

"Automating Climate Science: Large Ensemble Simulations on the TeraGrid with the GriPhyN Virtual Data System", Veronika Nefedova, Robert Jacob, Ian Foster, Zhengyu Liu, Yun Liu, Ewa Deelman, Gaurang Mehta, Mei-Hui Su, Karan Vahi. e-Science 2006, Amsterdam, December 4-6, 2006

"Comparison of Two Methods for Building Astronomical Image Mosaics on a Grid" Daniel S. Katz, Joseph C. Jacob, G. Bruce Berriman, John Good, Anastasia C. Laity, Ewa Deelman, Carl Kesselman, Gurmeet Singh, Mei-Hui Su, Thomas A. Prince. Parallel Processing, 2005. ICPP 2005 Workshops. International Conference Workshops on , pp. 85- 94, 14-17 June 2005 Paper on Applications using Pegasus

Grid-Based Galaxy Morphology Analysis for the National Virtual Observatory Ewa Deelman, Raymond Plante, Carl Kesselman, Gurmeet Singh, Mei-Hui Su, Gretchen Greene, Robert Hanisch, Niall Gaffney, Antonio Volpicelli, James Annis, Vijay Sekhri, Tamas Budavari, Maria Nieto-Santisteban, William O’Mullane, David Bohlender, Tom McGlynn, Arnold Rots, Olga Pevunova, Proceedings of SC 2003.

Montage A Grid Enabled Image Mosaic Service for the National Virtual Observatory G. B. Berriman , J. C. Good, A. C. Laity, A. Bergou, J. Jacob, D. S. Katz, E. Deelman, C. Kesselman, G. Singh, M.-H. Su, R. Williams, ADASS XIII, ASP Conference Series Vol XXX, F Ochsenbein M Allen and D Egret eds, 2003

Montage on the Grid Gurmeet Singh, Ewa Deelman, NVO Technical Report, April 3, 2003.
for more information on Montage, please visit http://montage.ipac.caltech.edu/

Multi-Wavelength Image Space: Another Grid-Enabled Science R. Williams, B. Berriman, E. Deelman, J. Good, J. Jacob, C. Kesselman, C. Lonsdale, S. Oliver, T. Prince. Journal of Concurrency and Computation: Practice and Experience, Wiley, March 2003.

GriPhyN and LIGO, building a virtual data grid for gravitational wave scientists E. Deelman, C. Kesselman, G. Mehta, L. Meshkat, L. Pearlman, K. Blackburn, P. Ehrens, A. Lazzarini, R. Williams, S. Koranda. High Performance Distributed Computing, 2002. HPDC-11 2002. Page(s): 225 -234

Book Chapters discussing Pegasus.

"Pegasus: Mapping Large-Scale Workflows to Distributed Resources, Ewa Deelman, Gaurang Mehta, Gurmeet Singh, Mei-Hui Su, and Karan Vahi", in Workflows for e-Science, 2007

"Generating Complex Astronomy Workflows, G. Bruce Berriman, Ewa Deelman, John Good, Joseph C. Jacob, Daniel S. Katz, Anastasia C. Laity, Thomas A. Prince, Gurmeet Singh, and Mei-Hui Su", in Workflows for e-Science, 2007

"SCEC CyberShake WorkflowsŽâ€”Automating Probabilistic Seismic Hazard Analysis Calculations, Philip Maechling, Ewa Deelman, Li Zhao, Robert Graves, Gaurang Mehta, Nitin Gupta, John Mehringer, Carl Kesselman, Scott Callaghan, David Okaya, Hunter Francoeur, Vipin Gupta, Yifeng Cui, Karan Vahi, Thomas Jordan, and Edward Field", in Workflows for e-Science, 2007

Brochures and Posters (warning poster files are HUGE!)

Some Ideas about General Workflow Management Architectures

Overall architecture and control flow, Ewa Deelman, Ian Foster, Carl Kesselman, Reagan Moore, Sanjay Ranka,  GriPhyN technical report 2004-24, December 2003

This technical report gives an overview of a new architecture being discussed within GriPhyN. This architecture formalizes the workflow generation, refinement and execution processes as graph manipulation (editing) processes.

Types of Editors and Specifications, James Blythe, Richard Cavanaugh, Ewa Deelman, Ian Foster, Seung-Hye Jang, Carl Kesselman, Keith Marzullo, Reagan Moore, Valerie Taylor, Xianan Zhang,  GriPhyN technical report 2004-23, December 2003

This report describes the editors that can modify the scientific workflows developed within GriPhyN.

Books on Workflow Technologies


"Workflows for e-Science", Ian Taylor, Ewa Deelman, Dennis Gannon, and Matthew Shield (Eds.), Springer 2006