Using natural language processing to extract plant functional traits from unstructured text

Abstract

AbstractFunctional plant ecology aims to understand how functional traits govern the distribution of species along environmental gradients, the assembly of communities, and ecosystem functions and services. The rapid rise of functional plant ecology has been fostered by the mobilization and integration of global trait datasets, but significant knowledge gaps remain about the functional traits of the ∼380,000 vascular plant species worldwide. The acquisition of urgently needed information through field campaigns remains challenging, time-consuming and costly. An alternative and so far largely untapped resource for trait information is represented by texts in books, research articles and on the internet which can be mobilized by modern machine learning techniques.Here, we propose a natural language processing (NLP) pipeline that automatically extracts trait information from an unstructured textual description of a species and provides a confidence score. To achieve this, we employ textual classification models for categorical traits and question answering models for numerical traits. We demonstrate the proposed pipeline on five categorical traits (growth form, life cycle, epiphytism, climbing habit and life form), and three numerical traits (plant height, leaf length, and leaf width). We evaluate the performance of our new NLP pipeline by comparing results obtained using different alternative modeling approaches ranging from a simple keyword search to large language models, on two extensive databases, each containing more than 50,000 species descriptions.The final optimized pipeline utilized a transformer architecture to obtain a mean precision of 90.8% (range 81.6-97%) and a mean recall of 88.6% (77.4-97%) on the categorical traits, which is an average increase of 21.4% in precision and 57.4% in recall compared to a standard approach using regular expressions. The question answering model for numerical traits obtained a normalized mean absolute error of 10.3% averaged across all traits.The NLP pipeline we propose has the potential to facilitate the digitalization and extraction of large amounts of plant functional trait information residing in scattered textual descriptions. Additionally, our study adds to an emerging body of NLP applications in an ecological context, opening up new opportunities for further research at the intersection of these fields.