Affiliation:
1. Northeastern University, USA
2. Asapp, Argentina
3. Czech Technical University, Czechia
4. Northeastern University, USA / Czech Technical University, Czechia
Abstract
In order to generate efficient code, dynamic language compilers often need information, such as dynamic types, not readily available in the program source. Leveraging a mixture of static and dynamic information, these compilers speculate on the missing information. Within one compilation unit, they specialize the generated code to the previously observed behaviors, betting that past is prologue. When speculation fails, the execution must jump back to unoptimized code. In this paper, we propose an approach to further the specialization, by disentangling classes of behaviors into separate optimization units. With contextual dispatch, functions are versioned and each version is compiled under different assumptions. When a function is invoked, the implementation dispatches to a version optimized under assumptions matching the dynamic context of the call. As a proof-of-concept, we describe a compiler for the R language which uses this approach. Our implementation is, on average, 1.7× faster than the GNU R reference implementation. We evaluate contextual dispatch on a set of benchmarks and measure additional speedup, on top of traditional speculation with deoptimization techniques. In this setting contextual dispatch improves the performance of 18 out of 46 programs in our benchmark suite.
Funder
National Science Foundation
Office of Naval Research
Czech Ministry of Education, Youth and Sports from the Czech Operational Programme Research, Development, and Education
European Research Council
Publisher
Association for Computing Machinery (ACM)
Subject
Safety, Risk, Reliability and Quality,Software
Reference35 articles.
1. Dynamic function specialization
2. Virtual machine warmup blows hot and cold
3. Julia: dynamism and performance reconciled by design
4. Compatible genericity with run-time types for the Java programming language
5. Craig Chambers and David Ungar. 1989. Customization: Optimizing Compiler Technology for SELF a Dynamicallytyped Object-oriented Programming Language. In Programming Language Design and Implementation (PLDI). https: //doi.org/10.1145/73141.74831 10.1145/73141.74831 Craig Chambers and David Ungar. 1989. Customization: Optimizing Compiler Technology for SELF a Dynamicallytyped Object-oriented Programming Language. In Programming Language Design and Implementation (PLDI). https: //doi.org/10.1145/73141.74831 10.1145/73141.74831
Cited by
7 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Debugging Dynamic Language Features in a Multi-tier Virtual Machine;Proceedings of the 15th ACM SIGPLAN International Workshop on Virtual Machines and Intermediate Languages;2023-10-18
2. Reusing Just-in-Time Compiled Code;Proceedings of the ACM on Programming Languages;2023-10-16
3. Who You Gonna Call: Analyzing the Run-Time Call-Site Behavior of Ruby Applications;Proceedings of the 18th ACM SIGPLAN International Symposium on Dynamic Languages;2022-11-29
4. Deoptless: speculation with dispatched on-stack replacement and specialized continuations;Proceedings of the 43rd ACM SIGPLAN International Conference on Programming Language Design and Implementation;2022-06-09
5. Type stability in Julia: avoiding performance pathologies in JIT compilation;Proceedings of the ACM on Programming Languages;2021-10-20