Affiliation:
1. IMEC, Ghent University, 9000 Gent, Belgium
2. VERSES AI Research Lab, Los Angeles, CA 90016, USA
Abstract
Robust evidence suggests that humans explore their environment using a combination of topological landmarks and coarse-grained path integration. This approach relies on identifiable environmental features (topological landmarks) in tandem with estimations of distance and direction (coarse-grained path integration) to construct cognitive maps of the surroundings. This cognitive map is believed to exhibit a hierarchical structure, allowing efficient planning when solving complex navigation tasks. Inspired by human behaviour, this paper presents a scalable hierarchical active inference model for autonomous navigation, exploration, and goal-oriented behaviour. The model uses visual observation and motion perception to combine curiosity-driven exploration with goal-oriented behaviour. Motion is planned using different levels of reasoning, i.e., from context to place to motion. This allows for efficient navigation in new spaces and rapid progress toward a target. By incorporating these human navigational strategies and their hierarchical representation of the environment, this model proposes a new solution for autonomous navigation and exploration. The approach is validated through simulations in a mini-grid environment.
Funder
Flemish Government
Interuniversity microelectronics centre
Subject
General Physics and Astronomy
Reference66 articles.
1. Computational mechanisms of curiosity and goal-directed exploration;Schwartenbeck;eLife,2019
2. Levine, S., and Shah, D. (2022). Learning robotic navigation from experience: Principles, methods and recent results. Philos. Trans. R. Soc. B Biol. Sci., 378.
3. A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontiers;Placed;IEEE Trans. Robot.,2023
4. Clone-structured graph representations enable flexible learning and vicarious evaluation of cognitive maps;George;Nat. Commun.,2021
5. Hafner, D., Pasukonis, J., Ba, J., and Lillicrap, T. (2023). Mastering Diverse Domains through World Models. arXiv.