Abstract
AbstractWaste biorefining processes face significant challenges related to the variability of feedstocks. The supply and composition of multiple feedstocks in these processes can be uncertain, making it difficult to achieve economically feasible and sustainable waste valorization for large-scale production. Here, we introduce a reinforcement learning-based framework that aims to control these uncertainties and improve the efficiency of the process. The framework is tested on an anaerobic digestion process and is found to perform better than traditional control strategies. In the short term, it achieves faster target tracking with increased precision and accuracy, while in the long term, it shows adaptive and robust behavior even under additional seasonal supply variability, meeting downstream demand with high probability. This reinforcement learning-based framework offers a promising and scalable solution to address uncertainty issues in real-world biorefining processes. If implemented, this framework could contribute to sustainable waste management practices globally, making waste biorefining processes more economically viable and environmentally friendly.
Funder
United States Department of Agriculture | National Institute of Food and Agriculture
National Science Foundation
Publisher
Springer Science and Business Media LLC
Reference48 articles.
1. Bank, W. Global Waste to Grow by 70 Percent by 2050 Unless Urgent Action is Taken: World Bank Report (2018). https://www.worldbank.org/en/news/press-release/2018/09/20/global-waste-to-grow-by-70-percent-by-2050-unless-urgent-action-is-taken-world-bank-report.
2. Kaza, S. et al. What a Waste 2.0: A Global Snapshot of Solid Waste Management to 2050. Urban Development Series (World Bank Group, Washington, DC, USA, 2018).
3. Annevelink, B., Chavez, L. G., van Ree, R. & Gursel, I. V. Global biorefinery status report 2022. Tech. Rep., IEA Bioenergy.
4. UNEP. Global Waste Management Outlook (United Nations, 2016). https://www.un-ilibrary.org/content/books/9789210601597.
5. Asghar, A. et al. Current challenges of biomass refinery and prospects of emerging technologies for sustainable bioproducts and bioeconomy. Biofuels Bioprod. Biorefin. 16, 1478–1494 (2022).