Perturbing Line Pictures for Identification of Visual Features and Their Syntax

Abstract

Experiments are reported in which line pictures were perturbed by omission or displacement of a combination of single pixels, fragments of lines, contours, and whole figures. Different effects of perturbation were expected by selectively violating visual syntactic rules or by impeding the contribution of certain feature detectors. The deterioration of the perturbed picture was measured according to standard psychophysical methods by rating on a 5-point scale. Multivariate methods were used to single out the relative effects of perturbation by, respectively, a set of single pixels, line fragments, contours and whole figures. Lines, as opposed to loose pixels, are clearly powerful descriptors of the pictures; contours or whole figures do not add significantly to what lines already describe. Different effects were observed if perturbations were dislocations rather than removals. Then contours and whole figures showed a typical disrupting effect compared to line fragments. These results have consequences for the development of a syntax of visual form perception. The perturbation method seems appropriate for identifying features or syntactic rules, although the results are dependent on a number of environmental and contextual factors.