An application-level parallel I/O library for Earth system models-Reference-Cited by-同舟云学术

An application-level parallel I/O library for Earth system models

Published:2011-12-02 Issue:1 Volume:26 Page:43-53
ISSN:1094-3420
Container-title:The International Journal of High Performance Computing Applications
language:en
Short-container-title:The International Journal of High Performance Computing Applications

Author:

Dennis John M.¹,Edwards Jim²,Loy Ray³,Jacob Robert³,Mirin Arthur A.⁴,Craig Anthony P.²,Vertenstein Mariana²

Affiliation:

1. National Center for Atmospheric Research, Computer and Information Systems Laboratory, Boulder, CO, USA

2. National Center for Atmospheric Research Earth System Laboratory, USA

3. Argonne National Laboratory, Mathematics and Computer Science Division, USA

4. Lawrence Livermore National Laboratory, Center for Applied Scientific Computing, USA

Abstract

We describe the design and implementation of an application-level parallel I/O (PIO) library for the reading and writing of distributed arrays to several common scientific data formats. PIO provides the flexibility to control the number of I/O tasks through data rearrangement to an I/O friendly decomposition. This flexibility enables reductions in per task memory usage and improvements in disk I/O performance versus a serial I/O approach. We illustrate the impact various features within PIO have on memory usage and disk I/O bandwidth on a Cray XT5 system.

Publisher

SAGE Publications

Subject

Hardware and Architecture,Theoretical Computer Science,Software

Link

http://journals.sagepub.com/doi/pdf/10.1177/1094342011428143

Reference21 articles.

1. DataStager

2. Interactive desktop analysis of high resolution simulations: application to turbulent plume dynamics and current sheet formation

3. A prototype discovery environment for analyzing and visualizing terascale turbulent fluid flow simulations

Cited by 24 articles. 订阅此论文施引文献订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献

1. The 4DEnVar-based weakly coupled land data assimilation system for E3SM version 2;Geoscientific Model Development;2024-04-16

2. An Asynchronous Parallel I/O Framework for Mass Conservation Ocean Model;Applied Sciences;2023-12-13

3. CIOFC1.0: a common parallel input/output framework based on C-Coupler2.0;Geoscientific Model Development;2023-11-07

4. The DOE E3SM Model Version 2: Overview of the Physical Model and Initial Model Evaluation;Journal of Advances in Modeling Earth Systems;2022-12

5. pMEMCPY: a simple, lightweight, and portable I/O library for storing data in persistent memory;2021 IEEE International Conference on Cluster Computing (CLUSTER);2021-09