Standard Area Diagrams for Pecan Leaf Scab: Effect of Rater Experience, Location, and Leaf Size on Reliability and Accuracy of Visual Estimates

Abstract

Assessments of the severity of scab (Venturia effusa), an economically significant disease of pecan, are critical for determining pecan cultivar susceptibility, disease epidemiology, and integrated disease management approaches. We developed a standard area diagram (SAD) set to aid in assessments of pecan leaflet scab. Leaflets with scab lesions were harvested and scanned using a flatbed scanner at 600 dpi, and Fiji (ImageJ) was used to determine the actual percent disease severity. The SADs had 10 leaflets ranging in severity from 0.2 to 48.9%. Forty “small” (1.34 to 7.43 cm2) and 40 “large” (7.67 to 25.9 cm2) leaflet images were randomized for rater assessments. The images were assessed twice by 36 raters, first without and then with the SADs as a guide. Data were subjected to analysis using Lin’s concordance correlation coefficient (LCC, pc) to determine the accuracy of ratings and by intraclass correlation coefficient (ICC) analysis to determine interrater reliability. The effects of rater experience, rater location, and leaflet size were also determined. The SADs significantly improved the agreement between raters and the actual values (LCC, pc = 0.70 and 0.84 without and with the SADs, respectively). The reliability of estimates was improved (ICC = 0.54 and 0.82 without and with the SADs, respectively). The effect of rater location on overall concordance was significant without and with the SADs based on an analysis of variance using a generalized linear model and lsmeans separation (P < 0.05). A generalized linear mixed model analysis revealed that there was a significant interaction between rater location, experience, and the use of the SADs, with some raters having greater improvement in generalized bias and concordance. Raters had a significantly better accuracy when rating “small” leaves (LCC, pc = 0.86) compared with “large” leaves (LCC, pc = 0.82) when using the SADs, highlighting the impact of psychophysics on field evaluations of plant disease severity. The proposed SADs will serve as an improved tool for performing pecan leaflet scab assessments by the pecan research community.