Affiliation:
1. Carnegie Mellon University, Pittsburgh, PA, USA
2. Tsinghua University, Beijing, China
Abstract
The First-Come First-Served (FCFS) scheduling policy is the most popular scheduling algorithm used in practice. Furthermore, its usage is theoretically validated: for light-tailed job size distributions, FCFS has weakly optimal asymptotic tail of response time. But what if we don't just care about the asymptotic tail? What if we also care about the 99th percentile of response time, or the fraction of jobs that complete in under one second? Is FCFS still best? Outside of the asymptotic regime, only loose bounds on the tail of FCFS are known, and optimality is completely open.
In this paper, we introduce a new policy, Nudge, which is the first policy to provably stochastically improve upon FCFS. We prove that Nudge simultaneously improves upon FCFS at every point along the tail, for light-tailed job size distributions. As a result, Nudge outperforms FCFS for every moment and every percentile of response time. Moreover, Nudge provides a multiplicative improvement over FCFS in the asymptotic tail. This resolves a long-standing open problem by showing that, counter to previous conjecture, FCFS is not strongly asymptotically optimal.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Hardware and Architecture,Safety, Risk, Reliability and Quality,Computer Science (miscellaneous)
Reference40 articles.
1. Exponential Approximations for Tail Probabilities in Queues, I;Abate Joseph;Waiting Times.,1995
2. An analysis of emergency room wait time issues via computer simulation;Blake John T.;INFOR,1996
3. Tails in scheduling
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. WFO: Cloud-Edge Cooperative Data Offloading Strategy Akin to Water Flow;Applied Sciences;2023-05-10
2. On the Stochastic and Asymptotic Improvement of First-Come First-Served and Nudge Scheduling;Proceedings of the ACM on Measurement and Analysis of Computing Systems;2022-12
3. Nudge: Stochastically Improving upon FCFS;ACM SIGMETRICS Performance Evaluation Review;2021-06-22
4. Nudge: Stochastically Improving upon FCFS;Abstract Proceedings of the 2021 ACM SIGMETRICS / International Conference on Measurement and Modeling of Computer Systems;2021-05-31