OligoArchive-DSM: Columnar Design for Error-Tolerant Database Archival using Synthetic DNA

Abstract

ABSTRACTThe surge in demand for cost-effective, durable long-term archival media, coupled with density limitations of contemporary magnetic media, has resulted in synthetic DNA emerging as a promising new alternative. Today, the limiting factor for DNA-based data archival is the cost of writing (synthesis) and reading (sequencing) DNA. Newer techniques that reduce the cost often do so at the expense of reliability, as they introduce complex, technology-specific error patterns. In order to deal with such errors, it is important to design efficient pipelines that can carefully use redundancy to mask errors without amplifying overall cost. In this paper, we present OligoArchive-DSM (OA-DSM), an end-to-end DNA archival pipeline that can provide error-tolerant data storage at low read/write costs. Central to OA-DSM is a database-inspired columnar encoding technique that makes it possible to improve efficiency by enabling integrated decoding and consensus calling during data restoration.