Author:
Milano Nicola,Nolfi Stefano
Abstract
AbstractWe demonstrate how the evolutionary training of embodied agents can be extended with a curriculum learning algorithm that automatically selects the environmental conditions in which the evolving agents are evaluated. The environmental conditions are selected to adjust the level of difficulty to the ability level of the current evolving agents, and to challenge the weaknesses of the evolving agents. The method does not require domain knowledge and does not introduce additional hyperparameters. The results collected on two benchmark problems, that require to solve a task in significantly varying environmental conditions, demonstrate that the method proposed outperforms conventional learning methods and generates solutions which are robust to variations and able to cope with different environmental conditions.
Publisher
Springer Science and Business Media LLC
Reference31 articles.
1. Lehman, J. & Miikkulainen, R. Neuroevolution. Schorpedia 8(6), 30977 (2013).
2. Harvey, I., Husbands, P. & Cliff, D. Seeing the light: artificial evolution, real vision. From Anim. Anim. 3, 392–401 (1994).
3. Gomez, F. & Miikkulainen, R. Incremental evolution of complex general behavior. Adapt. Behav. 5(3–4), 317–342 (1997).
4. Mouret, J. B. & Doncieux, S. Incremental evolution of animats’ behaviors as a multi-objective optimization. In International Conference on Simulation of Adaptive Behavior. 210–219. (Springer, Berlin, Heidelberg, 2008).
5. Narvekar, S. et al. Curriculum learning for reinforcement learning domains: a framework and survey. J. Mach. Learn. Res. 21(181), 1–50 (2020).
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Interaction Rules Supporting Effective Flocking Behavior;Artificial Life;2024
2. Autoencoders as a Tool to Detect Nonlinear Relationships in Latent Variables Models;2023 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE);2023-10-25
3. Qualitative differences between evolutionary strategies and reinforcement learning methods for control of autonomous agents;Evolutionary Intelligence;2022-12-07
4. Progress and challenges in adaptive robotics;Frontiers in Robotics and AI;2022-10-24
5. Synaptic pruning with MAP-elites;Proceedings of the Genetic and Evolutionary Computation Conference Companion;2022-07-09