A review and framework for the evaluation of pixel-level uncertainty estimates in satellite aerosol remote sensing
-
Published:2020-02-03
Issue:2
Volume:13
Page:373-404
-
ISSN:1867-8548
-
Container-title:Atmospheric Measurement Techniques
-
language:en
-
Short-container-title:Atmos. Meas. Tech.
Author:
Sayer Andrew M.ORCID, Govaerts YvesORCID, Kolmonen Pekka, Lipponen AnttiORCID, Luffarelli MartaORCID, Mielonen Tero, Patadia Falguni, Popp Thomas, Povey Adam C., Stebel KerstinORCID, Witek Marcin L.ORCID
Abstract
Abstract. Recent years have seen the increasing inclusion of per-retrieval prognostic (predictive) uncertainty estimates within satellite aerosol optical depth (AOD) data sets, providing users with quantitative tools to assist in the optimal use of these data. Prognostic estimates contrast with diagnostic (i.e. relative to some external truth) ones, which are typically obtained using sensitivity and/or validation analyses. Up to now, however, the quality of these uncertainty estimates has not been routinely assessed. This study presents a review of existing prognostic and diagnostic approaches for quantifying uncertainty in satellite AOD retrievals, and it presents a general framework to evaluate them based on the expected statistical properties of ensembles of estimated uncertainties and actual retrieval errors. It is hoped that this framework will be adopted as a complement to existing AOD validation exercises; it is not restricted to AOD and can in principle be applied to other quantities for which a reference validation data set is available. This framework is then applied to assess the uncertainties provided by several satellite data sets (seven over land, five over water), which draw on methods from the empirical to sensitivity analyses to formal error propagation, at 12 Aerosol Robotic Network (AERONET) sites. The AERONET sites are divided into those for which it is expected that the techniques will perform well and those for which some complexity about the site may provide a more severe test. Overall, all techniques show some skill in that larger estimated uncertainties are generally associated with larger observed errors, although they are sometimes poorly calibrated (i.e. too small or too large in magnitude). No technique uniformly performs best. For powerful formal uncertainty propagation approaches such as optimal estimation, the results illustrate some of the difficulties in appropriate population of the covariance matrices required by the technique. When the data sets are confronted by a situation strongly counter to the retrieval forward model (e.g. potentially mixed land–water surfaces or aerosol optical properties outside the family of assumptions), some algorithms fail to provide a retrieval, while others do but with a quantitatively unreliable uncertainty estimate. The discussion suggests paths forward for the refinement of these techniques.
Publisher
Copernicus GmbH
Subject
Atmospheric Science
Reference166 articles.
1. Ahn, C., Torres, O., and Jethva, H.: Assessment of OMI near‐UV aerosol
optical depth over land, J. Geophys. Res.-Atmos., 119, 2457–2473,
https://doi.org/10.1002/2013JD020188, 2013. a 2. Baum, B. A., Menzel, W. P., Frey, R. A., Tobin, D. C., Holz, R. E., Ackerman,
S. A., Heidinger, A. K., and Yang, P.: MODIS Cloud-Top Property Refinements
for Collection 6, J. Appl. Meteorol. Clim., 51, 1145–1163,
https://doi.org/10.1175/JAMC-D-11-0203.1, 2012. a 3. Benedetti, A., Morcrette, J.‐J., Boucher, O., Dethof, A., Engelen, R. J., Fisher, M., Flentje, H., Huneeus, N., Jones, L., Kaiser, J. W., Kinne, S., Mangold, A., Razinger, M., Simmons, A. J., and Suttie, M.: Aerosol analysis and forecast in the European Centre
for Medium‐Range Weather Forecasts Integrated Forecast
System: 2. Data assimilation, J. Geophys. Res., 114, D13205,
https://doi.org/10.1029/2008JD011115, 2009. a 4. Benedetti, A., Reid, J. S., Knippertz, P., Marsham, J. H., Di Giuseppe, F., Rémy, S., Basart, S., Boucher, O., Brooks, I. M., Menut, L., Mona, L., Laj, P., Pappalardo, G., Wiedensohler, A., Baklanov, A., Brooks, M., Colarco, P. R., Cuevas, E., da Silva, A., Escribano, J., Flemming, J., Huneeus, N., Jorba, O., Kazadzis, S., Kinne, S., Popp, T., Quinn, P. K., Sekiyama, T. T., Tanaka, T., and Terradellas, E.: Status and future of numerical atmospheric aerosol prediction with a focus on data requirements, Atmos. Chem. Phys., 18, 10615–10643, https://doi.org/10.5194/acp-18-10615-2018, 2018. a 5. Bevan, S. L., North, P. R. J., Los, S. O., and Grey, W. M. F.: A global dataset
of atmospheric aerosol optical depth and surface reflectance from AATSR,
Remote Sens. Environ., 116, 199–210, https://doi.org/10.1016/j.rse.2011.05.024, 2012. a
Cited by
63 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
|
|