Saddle Point Optimization with Approximate Minimization Oracle and Its Application to Robust Berthing Control

Author:

Akimoto Youhei1ORCID,Miyauchi Yoshiki2,Maki Atsuo2

Affiliation:

1. Faculty of Engineering, Information and Systems, University of Tsukuba & RIKEN Center for Advanced Intelligence Project, Tsukuba, Ibaraki, Japan

2. Department of Naval Architecture and Ocean Engineering, Graduate School of Engineering, Osaka University, Yamadaoka, Suita, Osaka, Japan

Abstract

We propose an approach to saddle point optimization relying only on oracles that solve minimization problems approximately. We analyze its convergence property on a strongly convex–concave problem and show its linear convergence toward the global min–max saddle point. Based on the convergence analysis, we develop a heuristic approach to adapt the learning rate. An implementation of the developed approach using the (1+1)-CMA-ES as the minimization oracle, namely, Adversarial-CMA-ES, is shown to outperform several existing approaches on test problems. Numerical evaluation confirms the tightness of the theoretical convergence rate bound as well as the efficiency of the learning rate adaptation mechanism. As an example of real-world problems, the suggested optimization method is applied to automatic berthing control problems under model uncertainties, showing its usefulness in obtaining solutions robust to uncertainty.

Funder

JSPS KAKENHI

Publisher

Association for Computing Machinery (ACM)

Subject

Process Chemistry and Technology,Economic Geology,Fuel Technology

Reference51 articles.

1. Martin A. Abkowitz. 1980. Measurement of hydrodynamic characteristics from ship maneuvering trials by system identification. In Transactions of Society of Naval Architects and Marine Engineers 88. 283–318.

2. Leonard Adolphs, Hadi Daneshmand, Aurelien Lucchi, and Thomas Hofmann. 2019. Local saddle point optimization: A curvature exploitation approach. In Proceedings of the International Conference on Artificial Intelligence and Statistics. 486–495.

3. Youhei Akimoto. 2021. Saddle point optimization with approximate minimization oracle. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO’21). 493–501.

4. Diagonal Acceleration for Covariance Matrix Adaptation Evolution Strategies

5. Abdullah Al-Dujaili, Shashank Srikant, Erik Hemberg, and Una-May O’Reilly. 2019. On the application of danskin’s theorem to derivative-free minimax problems. In Proceedings of the AIP Conference, Vol. 2070. 20–26.

Cited by 8 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Automatic Berthing Based on Reinforcement Learning and Feedback Control;2023 IEEE 6th International Conference on Pattern Recognition and Artificial Intelligence (PRAI);2023-08-18

2. Trade-off Between Robustness and Worst-Case Performance in Min-Max Optimization;Proceedings of the Genetic and Evolutionary Computation Conference;2023-07-12

3. Ship Autonomous Berthing Simulation Based on Covariance Matrix Adaptation Evolution Strategy;Journal of Marine Science and Engineering;2023-07-11

4. Covariance Matrix Adaptation Evolutionary Strategy with Worst-Case Ranking Approximation for Min–Max Optimization and Its Application to Berthing Control Tasks;ACM Transactions on Evolutionary Learning and Optimization;2023-06-28

5. Automatic berthing control under wind disturbances and its implementation in an embedded system;Journal of Marine Science and Technology;2023-03-31

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3