Optimizing File Transfer in Distributed Storage System Based on Reconfiguration of Storage Structure

Abstract

Abstract Distributed storage is the storage part of distributed computing. It is an easy-to-expand and virtualized storage resource pool. In order to meet the needs of large-scale storage structure applications, reliable mass data storage services are provided. Redundant data storage is needed to deal with the data unreliability caused by node failure. The lower the cost of file transmission, the less traffic generated in the network. According to the time logic, the regeneration process is divided into stages: data distribution, data encoding and decoding, data transmission and data reconstruction. The feedback mechanism can reduce the overhead of acquiring the load information of the data server node while ensuring the real-time performance. The determination of the activity factor function of the data block access frequency statistics needs to be established in the performance adaptability of the data block activity factor and the specific access times. The single-point dependency of the centralized storage system on the primary node is changed, which reduces the waiting delay of concurrent users and the average memory usage of the metadata server.