A novel observation points‐based positive‐unlabeled learning algorithm

Abstract

AbstractIn this study, an observation points‐based positive‐unlabeled learning algorithm (hence called OP‐PUL) is proposed to deal with positive‐unlabeled learning (PUL) tasks by judiciously assigning highly credible labels to unlabeled samples. The proposed OP‐PUL algorithm has three components. First, an observation point classifier ensemble (OPCE) algorithm is constructed to divide unlabeled samples into two categories, which are temporary positive and permanent negative samples. Second, a temporary OPC (TOPC) is trained based on the combination of original positive samples and permanent negative samples and then the permanent positive samples that are correctly classified with TOPC are retained from the temporary positive samples. Third, a permanent OPC (POPC) is finally trained based on the combination of original positive samples, permanent positive samples and permanent negative samples. An exhaustive experimental evaluation is conducted to validate the feasibility, rationality and effectiveness of the OP‐PUL algorithm, using 30 benchmark PU data sets. Results show that (1) the OP‐PUL algorithm is stable and robust as unlabeled samples and positive samples are increased in unlabeled data sets and (2) the permanent positive samples have a consistent probability distribution with the original positive samples. Moreover, a statistical analysis reveals that POPC in the OP‐PUL algorithm can yield better PUL performances on the 30 data sets in comparison with four well‐known PUL algorithms. This demonstrates that OP‐PUL is a viable algorithm to deal with PUL tasks.