Extended ProMap datasets for product mapping

Abstract

AbstractProduct mapping or product matching is the field of research dedicated to solving the problem of identifying which product listings (including names, descriptions, specifications, images, and other information) from different e-shops refer to the same product. The problem belongs among important data integration tasks processing data originating from different sources and with different structures. In our previous work, we created basic ProMapEn and ProMapCz datasets for product mapping in English and Czech. The main advantage of the ProMap datasets compared to existing product mapping datasets is that they contain different types of non-matches based on the similarity of the two products. In this paper, we extend the previous two datasets into a completely new collection of datasets for generalized product mapping in the Czech and English languages. We publish those datasets freely for other researchers in the area of product mapping on e-commerce. The main contributions are the extension of the ProMap datasets by adding a new class of non-matching products, the introduction of new ProMapMulti datasets of product pairs from multiple English e-shops, and the introduction of ProMapTransl datasets, obtained by translating the Czech datasets to English and vice versa. Moreover, we provide a very detailed analysis of these datasets with several experiments based on neural network techniques comparing different text preprocessing methods, and similarity computation methods. We also compare the differences among several product categories and evaluate state-of-the-art product mapping methods on these datasets. We also include generalised entity matching techniques and compare their behaviour on product mapping datasets which belong to this area. Finally, we include an appendix with a number of other basic experiments, such as an analysis of feature importances.