Extending the BESS Lifetime: A Cooperative Multi-Agent Deep Q Network Framework for a Parallel-Series Connected Battery Pack

Author:

Doan Nhat Quang1ORCID,Shahid Syed Maaz1ORCID,Duong Tho Minh1ORCID,Choi Sung-Jin1ORCID,Kwon Sungoh1ORCID

Affiliation:

1. Department of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea

Abstract

In this paper, we propose a battery management algorithm to maximize the lifetime of a parallel-series connected battery pack with heterogeneous states of health in a battery energy storage system. The growth of retired lithium-ion batteries from electric vehicles increases the applications for battery energy storage systems, which typically group multiple individual batteries with heterogeneous states of health in parallel and series to achieve the required voltage and capacity. However, previous work has primarily focused on either parallel or series connections of batteries due to the complexity of managing diverse battery states, such as state of charge and state of health. To address the scheduling in parallel-series connections, we propose a cooperative multi-agent deep Q network framework that leverages multi-agent deep reinforcement learning to observe multiple states within the battery energy storage system and optimize the scheduling of cells and modules in a parallel-series connected battery pack. Our approach not only balances the states of health across the cells and modules but also enhances the overall lifetime of the battery pack. Through simulation, we demonstrate that our algorithm extends the battery pack’s lifetime by up to 16.27% compared to previous work and exhibits robustness in adapting to various power demand conditions.

Funder

National Research Foundation of Korea

Ministry of Education

Korea Hydro and Nuclear Power Co.

Publisher

MDPI AG

Reference39 articles.

1. Hunt, G. (1996). USABC Electric Vehicle Battery Test Procedures Manual, Revision 2.

2. (2017). Examples for Reuse of Power Batteries. Reuse and Recycling of Lithium-Ion Power Batteries, John Wiley & Sons, Ltd.. Chapter 3.

3. Second life of electric vehicle batteries: Relation between materials degradation and environmental impact;Aguesse;Int. J. Life Cycle Assess.,2015

4. Wang, L., Yusheng, S., Wang, X., Wang, Z., and Zhao, X. (2019). Reliability Modeling Method for Lithium-ion Battery Packs Considering the Dependency of Cell Degradations Based on a Regression Model and Copulas. Materials, 12.

5. Battery second life: Hype, hope or reality? A critical review of the state of the art;Gandiaga;Renew. Sustain. Energy Rev.,2018

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3