Abstract
One of the consequences of the big data revolution is that data are more heterogeneous than ever. A new challenge appears when mixed-type data sets evolve over time and we are interested in the comparison among individuals. In this work, we propose a new protocol that integrates robust distances and visualization techniques for dynamic mixed data. In particular, given a time t∈T={1,2,…,N}, we start by measuring the proximity of n individuals in heterogeneous data by means of a robustified version of Gower’s metric (proposed by the authors in a previous work) yielding to a collection of distance matrices {D(t),∀t∈T}. To monitor the evolution of distances and outlier detection over time, we propose several graphical tools: First, we track the evolution of pairwise distances via line graphs; second, a dynamic box plot is obtained to identify individuals which showed minimum or maximum disparities; third, to visualize individuals that are systematically far from the others and detect potential outliers, we use the proximity plots, which are line graphs based on a proximity function computed on {D(t),∀t∈T}; fourth, the evolution of the inter-distances between individuals is analyzed via dynamic multiple multidimensional scaling maps. These visualization tools were implemented in the Shinny application in R, and the methodology is illustrated on a real data set related to COVID-19 healthcare, policy and restriction measures about the 2020–2021 COVID-19 pandemic across EU Member States.
Funder
Spanish Ministry of Science and Innovation
Subject
General Physics and Astronomy
Reference20 articles.
1. Distance Metrics and Clustering Methodsfor Mixed-type Data;Foss;Int. Stat. Rev.,2019
2. Learning a mahalanobis metric from equivalence constraints;Bar-Hillel;J. Mach. Learn. Res.,2005
3. Jian, S., Hu, L., Cao, L., and Lu, K. Metric-Based Auto-Instructor for Learning Mixed Data Representation. Proceedings of the AAAI Conference on Artificial Intelligence.
4. Robust Distance Metric Learning via Bayesian Inference;Wang;IEEE Trans. Image Process.,2018
5. On visualizing mixed-type data: A joint metric approach to profile construction and outlier detection;Grané;Sociol. Methods Res.,2018