Materialization and Reuse Optimizations for Production Data Science Pipelines-Reference-Cited by-同舟云学术

Materialization and Reuse Optimizations for Production Data Science Pipelines

Published:2022-06-10 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 2022 International Conference on Management of Data
language:
Short-container-title:

Author:

Derakhshan Behrouz¹,Rezaei Mahdiraji Alireza²,Kaoudi Zoi³,Rabl Tilmann⁴,Markl Volker⁵

Affiliation:

1. DFKI GmbH, Berlin, Germany

2. Yara Digital Production, Berlin, Germany

3. TU Berlin, Berlin, Germany

4. HPI & University of Potsdam, Potsdam, Germany

5. TU Berlin & DFKI GmbH, Berlin, Germany

Funder

German Ministry for Education and Research as BIFOLD - Berlin Institute for the Foundations of Learning and Data

German Federal Ministry for Economic Affairs and Climate Action, Project ?ExDRa?

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3514221.3526186

Reference59 articles.

1. Jordan T Ash and Ryan P Adams . 2019. On the difficulty of warm-starting neural network training. arXiv preprint arXiv:1910.08475 ( 2019 ). Jordan T Ash and Ryan P Adams. 2019. On the difficulty of warm-starting neural network training. arXiv preprint arXiv:1910.08475 (2019).

2. Pierre Baldi , Peter Sadowski , and Daniel Whiteson . 2014. Searching for exotic particles in high-energy physics with deep learning. Nature communications , Vol. 5 , 1 ( 2014 ), 1--9. Pierre Baldi, Peter Sadowski, and Daniel Whiteson. 2014. Searching for exotic particles in high-energy physics with deep learning. Nature communications, Vol. 5, 1 (2014), 1--9.

3. TFX

4. Principles of dataset versioning

5. Jeffrey Chung . 2020. NYC Taxi Trip - Public. kaggle.com/jeffreycbw/nyc-taxi-trip-public-0--37399-private-0--37206 Retrieved August 23, 2021 from Jeffrey Chung. 2020. NYC Taxi Trip - Public. kaggle.com/jeffreycbw/nyc-taxi-trip-public-0--37399-private-0--37206 Retrieved August 23, 2021 from

Cited by 5 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. Reproducible data science over data lakes: replayable data pipelines with Bauplan and Nessie;Proceedings of the Eighth Workshop on Data Management for End-to-End Machine Learning;2024-06-09

2. To Store or Not to Store: a graph theoretical approach for Dataset Versioning;2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS);2024-05-27

3. HYPPO: Using Equivalences to Optimize Pipelines in Exploratory Machine Learning;2024 IEEE 40th International Conference on Data Engineering (ICDE);2024-05-13

4. Optimizing Data Pipelines for Machine Learning in Feature Stores;Proceedings of the VLDB Endowment;2023-09

5. Raven;Proceedings of the Workshop on Human-In-the-Loop Data Analytics;2023-06-18