Knowledge injection of Datalog rules via Neural Network Structuring with KINS

Abstract

Abstract We propose a novel method to inject symbolic knowledge in form of Datalog formulæ into neural networks (NN), called Knowledge Injection via Network Structuring (KINS). The idea behind our method is to extend NN internal structure with ad-hoc layers built out of the injected symbolic knowledge. KINS does not constrain NN to any specific architecture, neither requires logic formulæ to be ground. Moreover, it is robust w.r.t. both lack of data and imperfect/incomplete knowledge. Experiments are reported, involving multiple datasets and predictor types, to demonstrate how KINS can significantly improve the predictive performance of the neural networks it is applied to.