Author:
Hernández-Orallo José,Loe Bao Sheng,Cheke Lucy,Martínez-Plumed Fernando,Ó hÉigeartaigh Seán
Abstract
AbstractSuccess in all sorts of situations is the most classical interpretation of general intelligence. Under limited resources, however, the capability of an agent must necessarily be limited too, and generality needs to be understood as comprehensive performance up to a level of difficulty. The degree of generality then refers to the way an agent’s capability is distributed as a function of task difficulty. This dissects the notion of general intelligence into two non-populational measures, generality and capability, which we apply to individuals and groups of humans, other animals and AI systems, on several cognitive and perceptual tests. Our results indicate that generality and capability can decouple at the individual level: very specialised agents can show high capability and vice versa. The metrics also decouple at the population level, and we rarely see diminishing returns in generality for those groups of high capability. We relate the individual measure of generality to traditional notions of general intelligence and cognitive efficiency in humans, collectives, non-human animals and machines. The choice of the difficulty function now plays a prominent role in this new conception of generality, which brings a quantitative tool for shedding light on long-standing questions about the evolution of general intelligence and the evaluation of progress in Artificial General Intelligence.
Funder
Future of Life Institute
EU (FEDER) and the Spanish MINECO
Generalitat Valenciana
Leverhulme Trust
Defense Sciences Office, DARPA
European Commission
DG CONNECT and DG JRC of the European Commission
Publisher
Springer Science and Business Media LLC
Reference62 articles.
1. Pintner, R. Intelligence and its measurement: A symposium-v. J. Educ. Psychol. 12, 139 (1921).
2. Fogel, D. B. Evolutionary Computation: Toward a New Philosophy of Machine Intelligence (IEEE Press, 1995).
3. Legg, S. & Hutter, M. Universal intelligence: A definition of machine intelligence. Minds Mach. 17, 391–444 (2007).
4. Mnih, V. et al. Human-level control through deep reinforcement learning. Nature 518, 529–533 (2015).
5. Yang, J. et al. General learning ability in perceptual learning. Proc. Natl. Acad. Sci. 117, 19092–19100 (2020).
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献