Performance Evaluation of CCAM-CTM Regional Airshed Modelling for the New South Wales Greater Metropolitan Region

Abstract

A comprehensive evaluation of the performance of the coupled Conformal Cubic Atmospheric Model (CCAM) and Chemical Transport Model (CTM) (CCAM-CTM) for the New South Wales Greater Metropolitan Region (NSW GMR) was conducted based on modelling results for two periods coinciding with measurement campaigns undertaken during the Sydney Particle Study (SPS), namely the summer in 2011 (SPS1) and the autumn in 2012 (SPS2). The model performance was evaluated for fine particulate matter (PM2.5), ozone (O3) and nitrogen dioxide (NO2) against air quality data from the NSW Government’s air quality monitoring network, and PM2.5 components were compared with speciated PM measurements from the Sydney Particle Study’s Westmead sampling site. The model tends to overpredict PM2.5 with normalised mean bias (NMB) less than 20%, however, moderate underpredictions of the daily peak are found on high PM2.5 days. The PM2.5 predictions at all sites comply with performance criteria for mean fractional bias (MFB) of ±60%, but only PM2.5 predictions at Earlwood further comply with the performance goal for MFB of ±30% during both periods. The model generally captures the diurnal variations in ozone with a slight underestimation. The model also tends to underpredict daily maximum hourly ozone. Ozone predictions across regions in SPS1, as well as in Sydney East, Sydney Northwest and Illawarra regions in SPS2 comply with the benchmark of MFB of ±15%, however, none of the regions comply with the benchmark for mean fractional error (MFE) of 35%. The model reproduces the diurnal variations and magnitudes of NO2 well, with a slightly underestimating tendency across the regions. The MFE and normalised mean error (NME) for NO2 predictions fall well within the ranges inferred from other studies. Model results are within a factor of two of measured averages for sulphate, nitrate, sodium and organic matter, with elemental carbon, chloride, magnesium and ammonium being underpredicted. The overall performance of CCAM-CTM modelling system for the NSW GMR is comparable to similar model predictions by other regional airshed models documented in the literature. The performance of the modelling system is found to be variable according to benchmark criteria and depend on the location of the sites, as well as the time of the year. The benchmarking of CCAM-CTM modelling system supports the application of this model for air quality impact assessment and policy scenario modelling to inform air quality management in NSW.