Feature selection using fuzzy-neighborhood relative decision entropy with class-level priority fusion

Abstract

Feature selection facilitates classification learning and can resort to uncertainty measurement of rough set theory. By fuzzy neighborhood rough sets, the fuzzy-neighborhood relative decision entropy (FNRDE) motivates a recent algorithm of feature selection, called AFNRDE. However, FNRDE has fusion defects for interaction priority and hierarchy deepening, and such fusion limitations can be resolved by operational commutativity; furthermore, subsequent AFNRDE has advancement space for effective recognition. For the measurement reinforcement, an improved measure (called IFNRDE) is proposed to pursue class-level priority fusion; for the algorithm promotion, the corresponding selection algorithm (called AIFNRDE) is designed to improve AFNRDE. Concretely, multiplication fusion of algebraic and informational measures is preferentially implemented at the class level, and the hierarchical summation generates classification-level IFNRDE. IFNRDE improves FNRDE, and its construction algorithm and granulation monotonicity are acquired. Then, IFNRDE motivates a heuristic algorithm of feature selection, i.e., AIFNRDE. Finally, relevant measures and algorithms are validated by table examples and data experiments, and new AIFNRDE outperforms current AFNRDE and relevant algorithms FSMRDE, FNRS, FNGRS for classification performances.