Leveraging Large Language Models for Tradespace Exploration

Abstract

This paper proposes a method for leveraging large language models (LLMs) to improve the question-answering capabilities of artificial intelligence (AI) assistants for tradespace exploration. The method operates by querying an information space composed of fused data sources encompassing the tradespace exploration process and responding based on the gathered information. The information retrieval process is modeled as an internal dialog where an LLM-based dialog agent converses with a subquery answering agent. A case study is conducted on a next-generation soil moisture mission (SM-NG), and a generative AI assistant (named Daphne-G) is configured on it. The effect of the dialog agent and the choice of LLM are assessed by comparing the performance of three different system configurations on a validation question set. A second validation effort is conducted, comparing Daphne-G’s responses to those of a baseline template-based AI assistant, Daphne-VA. Results show that the dialog-based system is necessary for answering complex questions requiring multiple documents. Furthermore, results show that Daphne-G can correctly answer all the questions Daphne-VA can answer, while simultaneously being able to answer a greater number of questions than Daphne-VA. The results suggest that LLMs could significantly improve the outcomes of the tradespace exploration process, which may result in better and more cost-effective mission concepts being implemented.