Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems-Reference-Cited by-同舟云学术

Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems

Published:2005 Issue:3 Volume:13 Page:219-237
ISSN:1058-9244
Container-title:Scientific Programming
language:en
Short-container-title:Scientific Programming

Author:

Deelman Ewa¹,Singh Gurmeet¹,Su Mei-Hui¹,Blythe James¹,Gil Yolanda¹,Kesselman Carl¹,Mehta Gaurang¹,Vahi Karan¹,Berriman G. Bruce²,Good John²,Laity Anastasia²,Jacob Joseph C.³,Katz Daniel S.³

Affiliation:

1. University of Southern California Information Sciences Institute, CA, USA

2. Infrared Processing and Analysis Center, California Institute of Technology, CA, USA

3. Jet Propulsion Laboratory, California Institute of Technology, CA, USA

Abstract

This paper describes the Pegasus framework that can be used to map complex scientific workflows onto distributed resources. Pegasus enables users to represent the workflows at an abstract level without needing to worry about the particulars of the target execution systems. The paper describes general issues in mapping applications and the functionality of Pegasus. We present the results of improving application performance through workflow restructuring which clusters multiple tasks in a workflow into single entities. A real-life astronomy application is used as the basis for the study.

Funder

National Science Foundation

Publisher

Hindawi Limited

Subject

Computer Science Applications,Software

Link

http://downloads.hindawi.com/journals/sp/2005/128026.pdf

Cited by 290 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Rapid simulations of atmospheric data assimilation of hourly-scale phenomena with modern neural networks;Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis;2023-11-11

2. Research on a Universal and Scalable Simulation Software Integration Framework;2023 IEEE 3rd International Conference on Computer Systems (ICCS);2023-09-22

3. Optimising workflow execution for energy consumption and performance;2023 IEEE/ACM 7th International Workshop on Green And Sustainable Software (GREENS);2023-05

4. CD/CV: Blockchain-based schemes for continuous verifiability and traceability of IoT data for edge–fog–cloud;Information Processing & Management;2023-01

5. Failure Prediction for Scientific Workflows Using Nature-Inspired Machine Learning Approach;Intelligent Automation & Soft Computing;2023