Text Classification Using SVM with Exponential Kernel

Abstract

Text classification presents difficult challenges due to the high dimensionality and sparsity of text data, and to the complex semantics of the natural language. Typically, in text classification the documents are represented in the vector space using the Bag of words (BoW) technique. Despite its ease of use, BoW representation does not consider the semantic similarity between words. In this paper, we overcome the shortage of the BoW approach by applying the exponential kernel, which models semantic similarity by means of a diffusion process on a graph defined by lexicon and co-occurrence information, to enrich the BoW representation. Combined with the support vector machine (SVM), experimental evaluation on real data sets demonstrates that our approach successfully achieves improved classification accuracy with respect to the BoW approach.