Self-tuning serverless task farming using proactive elasticity control
-
Published:2020-07-23
Issue:2
Volume:24
Page:799-817
-
ISSN:1386-7857
-
Container-title:Cluster Computing
-
language:en
-
Short-container-title:Cluster Comput
Author:
Kehrer Stefan,Zietlow Dominik,Scheffold Jochen,Blochinger Wolfgang
Abstract
AbstractThe cloud evolved into an attractive execution environment for parallel applications, which make use of compute resources to speed up the computation of large problems in science and industry. Whereas Infrastructure as a Service (IaaS) offerings have been commonly employed, more recently, serverless computing emerged as a novel cloud computing paradigm with the goal of freeing developers from resource management issues. However, as of today, serverless computing platforms are mainly used to process computations triggered by events or user requests that can be executed independently of each other and benefit from on-demand and elastic compute resources as well as per-function billing. In this work, we discuss how to employ serverless computing platforms to operate parallel applications. We specifically focus on the class of parallel task farming applications and introduce a novel approach to free developers from both parallelism and resource management issues. Our approach includes a proactive elasticity controller that adapts the physical parallelism per application run according to user-defined goals. Specifically, we show how to consider a user-defined execution time limit after which the result of the computation needs to be present while minimizing the associated monetary costs. To evaluate our concepts, we present a prototypical elastic parallel system architecture for self-tuning serverless task farming and implement two applications based on our framework. Moreover, we report on performance measurements for both applications as well as the prediction accuracy of the proposed proactive elasticity control mechanism and discuss our key findings.
Publisher
Springer Science and Business Media LLC
Subject
Computer Networks and Communications,Software
Reference56 articles.
1. Aggarwal, C.C.: Data Mining: The Textbook. Springer, New York (2015) 2. Aldinucci, M., Danelutto, M., Teti, P.: An advanced environment supporting structured parallel programming in java. Future Gener. Comput. Syst. 19(5), 611–626 (2003) 3. Aldinucci, M., Campa, S., Danelutto, M., Vanneschi, M., Kilpatrick, P., Dazzi, P., Laforenza, D., Tonellotto, N.: Behavioural skeletons in GCM: autonomic management of grid components. In: 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008). IEEE, pp 54–63 (2008) 4. Aldinucci, M., Danelutto, M., Kilpatrick, P.: Co-design of distributed systems using skeleton and autonomic management abstractions. In: César, E., Alexander, M., Streit, A., Träff, J.L., Cérin, C., Knüpfer, A., Kranzlmüller, D., Jha, S. (eds.) Euro-Par 2008 Workshops—Parallel Processing, pp. 403–414. Springer, Heidelberg (2009) 5. Alexandre, F., Marques, R., Paulino, H.: On the support of task-parallel algorithmic skeletons for multi-GPU computing. In: Proceedings of the 29th Annual ACM Symposium on Applied Computing, ACM, New York, NY, USA, SAC ’14, pp. 880–885 (2014)
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|