1. Given that counting is needed for learning (see below), distributed representations have the flexibility to represent and count recognition events that have not been foreseen;Arguments in favour of direct representations include
2. Starting from the reasonable premise that learning requires an ability to count the frequencies of perceptual entities, Gardner-Medwin and Barlow argue that "compact distributed representations (i.e., ones with little redundancy) enormously reduce the efficiency of counting and must therefore slow reliable learning, but that this is not References J. J. Atick. Could information theory provide an ecological theory of sensory processing;Network,1992
3. Some informational aspects of visual perception;F Attneave;Psychological Review,1954
4. Information Theory and the Brain