Exploring Reinforcement Learning Methods for Multiple Sequence Alignment: A Brief Review

Abstract

Multiple sequence alignment (MSA) plays a vital role in uncovering similarities among biological sequences such as DNA, RNA, or proteins, providing valuable information about their structural, functional, and evolutionary relationships. However, MSA is a computationally challenging problem, with complexity growing exponentially as the number and length of sequences increase. Currently, standard MSA tools like ClustalW, T-Coffee, and MAFFT, which are based on heuristic algorithms, are widely used but still face many challenges due to the combinatorial explosion. Recent advancements in MSA algorithms have employed reinforcement learning (RL), particularly deep reinforcement learning (DRL), and demonstrated optimized execution time and accuracy with promising results. This is because deep reinforcement learning algorithms update their search policies using gradient descent, instead of exploring the entire solution space making it significantly faster and efficient. In this article, we provide an overview of the recent historical advancements in MSA algorithms, highlighting RL models used to tackle the MSA problem and main challenges and opportunities in this regard.