Towards Migration-Free "Just-in-Case" Data Archival for Future Cloud Data Lakes Using Synthetic DNA-Reference-Cited by-同舟云学术

Towards Migration-Free "Just-in-Case" Data Archival for Future Cloud Data Lakes Using Synthetic DNA

Published:2023-04 Issue:8 Volume:16 Page:1923-1929
ISSN:2150-8097
Container-title:Proceedings of the VLDB Endowment
language:en
Short-container-title:Proc. VLDB Endow.

Author:

Marinelli Eugenio¹,Yan Yiqing¹,Magnone Virginie²,Dumargne Charlotte²,Barbry Pascal²,Heinis Thomas³,Appuswamy Raja¹

Affiliation:

1. Eurecom, France

2. IPMC, France

3. Imperial College London, UK

Abstract

Given the growing adoption of AI, cloud data lakes are facing the need to support cost-effective "just-in-case" data archival over long time periods to meet regulatory compliance requirements. Unfortunately, current media technologies suffer from fundamental issues that will soon, if not already, make cost-effective data archival infeasible. In this paper, we present a vision for redesigning the archival tier of cloud data lakes based on a novel, obsolescence-free storage medium-synthetic DNA. In doing so, we make two contributions: (i) we highlight the challenges in using DNA for data archival and list several open research problems, (ii) we outline OligoArchive-DSM (OA-DSM)-an end-to-end DNA storage pipeline that we are developing to demonstrate the feasibility of our vision.

Publisher

Association for Computing Machinery (ACM)

Subject

General Earth and Planetary Sciences,Water Science and Technology,Geography, Planning and Development

Link

https://dl.acm.org/doi/pdf/10.14778/3594512.3594522

Reference35 articles.

1. A Survey of Uncertain Data Algorithms and Applications

2. Patrick Anderson Richard Black Ausra Cerkauskaite Andromachi Chatzieleftheriou James Clegg Chris Dainty Raluca Diaconu Austin Donnelly Rokas Drevinskas Alexander Gaunt Andreas Georgiou Ariel Gomez Diaz Peter G. Kazansky David Lara Sergey Legtchenko Sebastian Nowozin Aaron Ogus Douglas Phillips Ant Rowstron Masaaki Sakakura Ioan Stefanovici Benn Thomsen and Lei Wang. 2018. Glass: A New Media for a New Era?. In HotStorage. Patrick Anderson Richard Black Ausra Cerkauskaite Andromachi Chatzieleftheriou James Clegg Chris Dainty Raluca Diaconu Austin Donnelly Rokas Drevinskas Alexander Gaunt Andreas Georgiou Ariel Gomez Diaz Peter G. Kazansky David Lara Sergey Legtchenko Sebastian Nowozin Aaron Ogus Douglas Phillips Ant Rowstron Masaaki Sakakura Ioan Stefanovici Benn Thomsen and Lei Wang. 2018. Glass: A New Media for a New Era?. In HotStorage.

3. Raja Appuswamy and Vincent Joguin. 2021. Universal Layout Emulation for Long-Term Database Archival. In CIDR. Raja Appuswamy and Vincent Joguin. 2021. Universal Layout Emulation for Long-Term Database Archival. In CIDR.

4. R. Appuswamy Kevin Lebrigand Pascal Barbry Marc Antonini Oliver Madderson Paul Freemont James MacDonald and Thomas Heinis. 2019. OligoArchive: Using DNA in the DBMS storage hierarchy. In CIDR. R. Appuswamy Kevin Lebrigand Pascal Barbry Marc Antonini Oliver Madderson Paul Freemont James MacDonald and Thomas Heinis. 2019. OligoArchive: Using DNA in the DBMS storage hierarchy. In CIDR.

5. Tuundefinedkan Batu Sampath Kannan Sanjeev Khanna and Andrew McGregor. 2004. Reconstructing Strings from Random Traces. In SODA. Tuundefinedkan Batu Sampath Kannan Sanjeev Khanna and Andrew McGregor. 2004. Reconstructing Strings from Random Traces. In SODA.