Author:
Padrao Paulo,Fuentes Jose,Bobadilla Leonardo,Smith Ryan N.
Abstract
Prediction and estimation of phenomena of interest in aquatic environments are challenging since they present complex spatio-temporal dynamics. Over the past few decades, advances in machine learning and data processing contributed to ocean exploration and sampling using autonomous robots. In this work, we formulate a reinforcement learning framework to estimate spatio-temporal fields modeled by partial differential equations. The proposed framework addresses problems of the classic methods regarding the sampling process to determine the path to be used by the agent to collect samples. Simulation results demonstrate the applicability of our approach and show that the error at the end of the learning process is close to the expected error given by the fitting process due to added noise.
Funder
National Science Foundation
U.S. Department of Homeland Security
Subject
Artificial Intelligence,Computer Science Applications
Reference60 articles.
1. Oceanographic research using remotely operated underwater robotic vehicles: Exploration;Bachmayer;Mar. Technol. Soc. J.,1998
2. Architecture of the Texas A&M autonomous underwater vehicle controller;Barnett;Proceedings of Symposium on Autonomous Underwater Vehicle Technology,1996
3. Development of an active, large volume, discrete seawater sampler for autonomous underwater vehicles;Bird,2007
4. Training with noise is equivalent to tikhonov regularization;Bishop;Neural Comput.,1995
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献