Application of a nonparametric technique for testing the hypothesis of independence of random variables in conditions of a large volume of statistical data-Reference-Cited by-同舟云学术

Application of a nonparametric technique for testing the hypothesis of independence of random variables in conditions of a large volume of statistical data

Published:2023-11-17 Issue:10 Volume: Page:17-24
ISSN:2949-5237
Container-title:Izmeritel`naya Tekhnika
language:
Short-container-title:jour

Author:

Lapko A. V.¹^ORCID,Lapko V. A.¹^ORCID,Bakhtina A. V.²

Affiliation:

1. Institute of Computational Modelling, Siberian Branch of the Russian Academy of Sciences; Reshetnev Siberian State University of Science and Technology

2. Reshetnev Siberian State University of Science and Technology

Abstract

The problem of testing the hypothesis about the independence of random variables in conditions of large volumes of statistical data is considered. The results of solving the problem are necessary when estimating probability densities of random variables and synthesizing information processing algorithms. A nonparametric technique is proposed for testing the hypothesis about the independence of random variables in a sample containing a large amount of statistical data. The technique is based on compression of the initial statistical information by decomposition of the range of values of random variables. The generated data array consists of the centers of sampling intervals and the corresponding frequencies of observations from the original sample. The information obtained is used in the construction of a nonparametric pattern recognition algorithm corresponding to the maximum likelihood criterion. The evaluation of the distribution laws in classes is carried out under the assumption of independence and dependence of the compared random variables. When restoring the laws of distribution of random variables in classes, regression estimates of probability densities are used. Under these conditions, estimates of the probabilities of pattern recognition errors in classes are calculated. According to their minimum value, a decision is made on the independence or dependence of random variables. The technique was applied in the analysis of remote sensing data of forest areas, linear and nonlinear dependencies between pairs of spectral characteristics of the objects of study were determined.Keywords:

Publisher

FSUE VNIIMS All-Russian Research Institute of Metrological Service

Subject

Industrial and Manufacturing Engineering,Materials Science (miscellaneous),Business and International Management

Reference26 articles.

1. Pugachev V. S., Teoriya veroyatnostej i matematicheskaya statistika [Probability theory and mathematical statistics: study guide], Moscow, Fizmatlit Publ., 2002, 496 p. (In Russ.)

2. Lapko A. V., Lapko V. A., Bakhtina A. V., Optoelectronics, Instrumentation and Data Processing, 2022, vol. 57, no. 6, pp. 639– 648. https://doi.org/10.3103/S8756699021060078

3. Lapko A. V., Lapko V. A., Bakhtina A. V., Measurement Techniques, 2022, vol. 65, no. 1, pp. 17–23. https://doi.org/10.1007/s11018-022-02043-2

4. Lapko A. V., Lapko V. A., Bakhtina A. V. Comparison of the methodology for hypothesis testing of the independence of two-dimensional random variables based on a nonparametric classifier. Scientific and Technical Information Processing, 2022, no. 1, pp. 45–56. (In Russ.)

5. Lapko A. V., Lapko V. A. Optoelectronics, Instrumentation and Data Processing, 2014, vol. 50, no 2, pp. 148–153. https://doi.org/10.3103/S875669901402006X