Discrimination tasks in simulated low‐dose CT noise

Abstract

AbstractBackgroundThis study reports the results of a set of discrimination experiments using simulated images that represent the appearance of subtle lesions in low‐dose computed tomography (CT) of the lungs. Noise in these images has a characteristic ramp‐spectrum before apodization by noise control filters. We consider three specific diagnostic features that determine whether a lesion is considered malignant or benign, two system‐resolution levels, and four apodization levels for a total of 24 experimental conditions.PurposeThe goal of the investigation is to better understand how well human observers perform subtle discrimination tasks like these, and the mechanisms of that performance. We use a forced‐choice psychophysical paradigm to estimate observer efficiency and classification images. These measures quantify how effectively subjects can read the images, and how they use images to perform discrimination tasks across the different imaging conditions.Materials and MethodsThe simulated CT images used as stimuli in the psychophysical experiments are generated from high‐resolution objects passed through a modulation transfer function (MTF) before down‐sampling to the image‐pixel grid. Acquisition noise is then added with a ramp noise‐power spectrum (NPS), with subsequent smoothing through apodization filters. The features considered are lesion size, indistinct lesion boundary, and a nonuniform lesion interior. System resolution is implemented by an MTF with resolution (10% max.) of 0.47 or 0.58 cyc/mm. Apodization is implemented by a Shepp‐Logan filter (Sinc profile) with various cutoffs. Six medically naïve subjects participated in the psychophysical studies, entailing training and testing components for each condition. Training consisted of staircase procedures to find the 80% correct threshold for each subject, and testing involved 2000 psychophysical trials at the threshold value for each subject. Human‐observer performance is compared to the Ideal Observer to generate estimates of task efficiency. The significance of imaging factors is assessed using ANOVA. Classification images are used to estimate the linear template weights used by subjects to perform these tasks. Classification‐image spectra are used to analyze subject weights in the spatial‐frequency domain.ResultsOverall, average observer efficiency is relatively low in these experiments (10%–40%) relative to detection and localization studies reported previously. We find significant effects for feature type and apodization level on observer efficiency. Somewhat surprisingly, system resolution is not a significant factor. Efficiency effects of the different features appear to be well explained by the profile of the linear templates in the classification images. Increasingly strong apodization is found to both increase the classification‐image weights and to increase the mean‐frequency of the classification‐image spectra. A secondary analysis of “Unapodized” classification images shows that this is largely due to observers undoing (inverting) the effects of apodization filters.ConclusionsThese studies demonstrate that human observers can be relatively inefficient at feature‐discrimination tasks in ramp‐spectrum noise. Observers appear to be adapting to frequency suppression implemented in apodization filters, but there are residual effects that are not explained by spatial weighting patterns. The studies also suggest that the mechanisms for improving performance through the application of noise‐control filters may require further investigation.