Text mining for Swiss-Prot curation: A story of success and failure

Abstract

AbstractA text mining group has been set up at the Swiss Institute of Bioinformatics, with objective to develop and adapt information retrieval and extraction tools to help Swiss-Prot curators in their daily annotation work. After over 7 year activities, this group has gathered a significant amount of experience about the need in text mining for biocuration.The first observation we made is that there is no “in-a-box” solution which can satisfy every needs. Each curator has his/her own strategy to find information from the literature and none of the existing information retrieval systems is able to compete with it, more for reason of habits than for reason of performance. Second observation: to be completely operative, an information retrieval system should be embedded in the annotation platform. For instance, it should be possible to copy/paste information, such as the article reference or some interesting sentences, directly in the database format. Most of the existing online programs are hardly adaptable for this task and their use usually results in additional editing efforts for the curators. From this observation, we can derive the fact that integrating text mining services is usually more costly than expected since wrappers and user interfaces need significant developments sometimes fairly user-specific.After noticing these problems in the design and use of a generic information retrieval system for the Swiss-Prot curators, we focused our effort on text mining applications for database update. The follow-up of the literature is essential in the process of database maintenance and there are needs for automatic information extraction tools on a large panel of topics. We developed several IE applications in the field of:- PTM information (phosphorylation, glycosylation, disulfide bridge)- Subcellular localization- Variant/mutation detection and characterization- New sequence with enzymatic activities- New characterization of enzymes.These tools are integrated into pipelines which follow PubMed daily outcomes and generate list of selected abstracts with highlights on the relevant sentences. These procedures are done independently of the usual annotation workflow, so that curators can mine these preselected data whenever they work on database entry updates.To conclude, we have identified big challenges in text mining services after discussion with the curators. One of them is the detection of novel information, especially those related to a new function or a new characterization of a protein or one of its close homologues. We are currently working on this task in the framework of the collaborative project “EAGL”. Another challenge is definitely the large-scale screening of newly published full-text papers to complement the often incomplete information in abstracts. This becomes more and more indispensable, not really for the annotation of widely studied “hot” proteins, but to find new data on uncharacterized ones. For instance, when no gene name has been attributed to a sequence, the only way to retrieve information is to use the orf names, which are never provided in abstracts.Finally, one should definitely stress that many of these information retrieval and extraction tasks could be greatly simplified with the requirement of metadata at the article submission time, such as an official HGNC gene name or a UniProt reference.