Euclidean distance-optimized data transformation for cluster analysis in biomedical data (EDOtrans)

Abstract

AbstractBackgroundData transformations are commonly used in bioinformatics data processing in the context of data projection and clustering. The most used Euclidean metric is not scale invariant and therefore occasionally inappropriate for complex, e.g., multimodal distributed variables and may negatively affect the results of cluster analysis. Specifically, the squaring function in the definition of the Euclidean distance as the square root of the sum of squared differences between data points has the consequence that the value 1 implicitly defines a limit for distances within clusters versus distances between (inter-) clusters.MethodsThe Euclidean distances within a standard normal distribution (N(0,1)) follow a N(0,$$\sqrt{2}$$2) distribution. The EDO-transformation of a variable X is proposed as$$EDO= X/(\sqrt{2}\cdot s)$$EDO=X/(2·s)following modeling of the standard deviationsby a mixture of Gaussians and selecting the dominant modes via item categorization. The method was compared in artificial and biomedical datasets with clustering of untransformed data, z-transformed data, and the recently proposed pooled variable scaling.ResultsA simulation study and applications to known real data examples showed that the proposed EDO scaling method is generally useful. The clustering results in terms of cluster accuracy, adjusted Rand index and Dunn’s index outperformed the classical alternatives. Finally, the EDO transformation was applied to cluster a high-dimensional genomic dataset consisting of gene expression data for multiple samples of breast cancer tissues, and the proposed approach gave better results than classical methods and was compared with pooled variable scaling.ConclusionsFor multivariate procedures of data analysis, it is proposed to use the EDO transformation as a better alternative to the established z-standardization, especially for nontrivially distributed data. The “EDOtrans” R package is available athttps://cran.r-project.org/package=EDOtrans.