Data-flow Reversal and Garbage Collection-Reference-Cited by-同舟云学术

Data-flow Reversal and Garbage Collection

Published:2023-11-18 Issue: Volume: Page:
ISSN:0098-3500
Container-title:ACM Transactions on Mathematical Software
language:en
Short-container-title:ACM Trans. Math. Softw.

Author:

Hascoët Laurent¹

Affiliation:

1. INRIA Sophia-Antipolis, France

Abstract

Data-flow reversal is at the heart of source-transformation reverse algorithmic differentiation (reverse ST-AD), arguably the most efficient way to obtain gradients of numerical models. However, when the model implementation language uses garbage collection (GC), for instance in Java or Python, the notion of address that is needed for data-flow reversal disappears. Moreover, GC is asynchronous and does not appear explicitly in the source. This paper presents an extension to the model of reverse ST-AD suitable for a language with GC. The approach is validated on a Java implementation of a simple Navier-Stokes solver. Performance is compared with existing AD tools ADOL-C and Tapenade on an equivalent implementation in C and Fortran.

Publisher

Association for Computing Machinery (ACM)

Subject

Applied Mathematics,Software

Link

https://dl.acm.org/doi/pdf/10.1145/3627537

Reference25 articles.

1. Automatic Differentiation in Machine Learning: a survey;Baydin A.;Journal of Machine Learning Research,2018

2. Martin Berz , Christian Bischof , George Corliss , and Andreas Griewank (Eds.). 1996 . Computational Differentiation: Techniques, Applications and Tools . SIAM , Philadelphia, PA . Martin Berz, Christian Bischof, George Corliss, and Andreas Griewank (Eds.). 1996. Computational Differentiation: Techniques, Applications and Tools. SIAM, Philadelphia, PA.

3. Christian H. Bischof H. Martin Bücker Paul D. Hovland Uwe Naumann and Jean Utke (Eds.). 2008. Advances in Automatic Differentiation. Lecture Notes in Computational Science and Engineering Vol. 64. Springer Berlin. https://doi.org/10.1007/978-3-540-68942-3 10.1007/978-3-540-68942-3

4. Christian H. Bischof H. Martin Bücker Paul D. Hovland Uwe Naumann and Jean Utke (Eds.). 2008. Advances in Automatic Differentiation. Lecture Notes in Computational Science and Engineering Vol. 64. Springer Berlin. https://doi.org/10.1007/978-3-540-68942-3

5. James Bradbury Roy Frostig Peter Hawkins Matthew James Johnson Chris Leary Dougal Maclaurin George Necula Adam Paszke Jake VanderPlas Skye Wanderman-Milne and Qiao Zhang. 2018. JAX: composable transformations of Python+NumPy programs. http://github.com/google/jax James Bradbury Roy Frostig Peter Hawkins Matthew James Johnson Chris Leary Dougal Maclaurin George Necula Adam Paszke Jake VanderPlas Skye Wanderman-Milne and Qiao Zhang. 2018. JAX: composable transformations of Python+NumPy programs. http://github.com/google/jax