Abstract
AbstractWe improve the efficiency of population genetic file formats and GWAS computation by leveraging the distribution of sample ordering in population-level genetic data. We identify conditional exchangeability of these data, recommending finite state entropy algorithms as an arithmetic code naturally suited to population genetic data. We show between 10% and 40% speed and size improvements over dictionary compression methods for population genetic data such as Zstd and Zlib in computation and and decompression tasks. We provide a prototype for genome-wide association study with finite state entropy compression demonstrating significant space saving and speed comparable to the state-of-the-art.
Publisher
Cold Spring Harbor Laboratory
Reference26 articles.
1. Adjeroh, D. , Zhang, Y. , Mukherjee, A. , et al. 2002. DNA sequence compression using the Burrows-Wheeler transform. In Proceedings of the ieee computer society bioinformatics conference.
2. Bycroft, C. , Freeman, C. , Petkova, D. , et al. 2018. The UK Biobank resource with deep phenotyping and genomic data. Nature, 562(7726).
3. Chang, C. C. , Chow, C. C. , Tellier, L. C. A. M. , et al. 2015. Second-generation PLINK: Rising to the challenge of larger and richer datasets. GigaScience, 4(1).
4. Chang et al. 2019. PLINK 2 File format specification draft. https://github.com/chrchang/plink-ng/tree/master/pgen_spec. (Accessed: Summer 2019)