Author:
Grewe V.,Moussiopoulos N.,Builtjes P.,Borrego C.,Isaksen I. S. A.,Volz-Thomas A.
Abstract
Abstract. We summarise results from a workshop on "Model Benchmarking and Quality Assurance" of the EU-Network of Excellence ACCENT, including results from other activities (e.g. COST Action 732) and publications. A formalised evaluation protocol is presented, i.e. a generic formalism describing the procedure how to perform a model evaluation. This includes eight steps and examples from global model applications are given for illustration. The first and important step is concerning the purpose of the model application, i.e. the addressed underlying scientific or political question. We give examples to demonstrate that there is no model evaluation per se, i.e. without a focused purpose. Model evaluation is testing, whether a model is fit for its purpose. The following steps are deduced from the purpose and include model requirements, input data, key processes and quantities, benchmark data, quality indicators, sensitivities, as well as benchmarking and grading. We define "benchmarking" as the process of comparing the model output against either observational data or high fidelity model data, i.e. benchmark data. Special focus is given to the uncertainties, e.g. in observational data, which have the potential to lead to wrong conclusions in the model evaluation if not considered carefully.
Reference46 articles.
1. ACCENT (Atmospheric Composition Change the European Network of Excellence): Answers to the Urbino Questions, ACCENTs first policy-driven synthesis, edited by: Raes F. and Hjorth J., published by: ACCENT Secretariat, University Urbino, Italy, ISBN 92-79-02413-2, http://www4.nilu.no/portal/publications/accent-series-reports, 2006.
2. ACCENT (Atmospheric Composition Change the European Network of Excellence): Editorial, edited by: Fuzzi, S. and Maione, M., Atmos. Environm., 43, 5136–5137, 2009.
3. Aghedo, A. M., Bowman, K. W., Shindell, D. T., and Faluvegi, G.: The impact of orbital sampling, monthly averaging and vertical resolution on climate chemistry model evaluation with satellite observations, Atmos. Chem. Phys., 11, 6493–6514, https://doi.org/10.5194/acp-11-6493-2011, 2011.
4. AIAA (American Institute of Aeronautics and Astronautics): Guide for the Verification and Validation of Computational Fluid Dynamics Simulations, American Institute of Aeronautics and Astronautics, AIAA-G-077-1998, Reston, VA, USA, 1998.
5. Braesicke, P. and Pyle, J.: Sensitivity of dynmaics and ozone to different representations of SSTs in the Unified Model, Q. J. Roy. Meteor. Soc., 130, 2033–2045, 2004.