Abstract
In this paper, the distributed implementation of Computing Language Model (CLM) in cloud computing network is studied and discussed. With the advent of the era of big data, the application of CLM in natural language processing (NLP), machine translation and other fields is increasingly extensive, and the demand for computing resources is also increasing. As an effective way to manage computing resources, distributed computing can make full use of resources in cloud computing environment and realize efficient execution of computing tasks. In this paper, the application of distributed computing methods such as data parallelism, model parallelism and hybrid parallelism in cloud computing environment is studied and analyzed, and the advantages and disadvantages of different methods in CLM implementation are discussed. The experimental results show that the hybrid parallel method can effectively combine the advantages of data parallelism and model parallelism, and improve the training efficiency and performance of CLM. This study provides important theoretical guidance and technical support for the distributed implementation of CLM in cloud computing networks, and is of great significance for further promoting the development of big data and AI technology.
Reference10 articles.
1. Liu B, Cao Y, Zhang Y, & Jiang T. (2020). A distributed framework for task offloading in edge computing networks of arbitrary topology. IEEE Transactions on Wireless Communications, 2020(99), 1-1.
2. Li M, Zhang J, Wan J, Ren Y, Zhou L, & Wu B, et al. (2020). Distributed machine learning load balancing strategy in cloud computing services. Wireless Networks, 26(8), 5517-5533.
3. Wang L, Pang Y, Zhou B, & Jin S. (2020). Cloud-fog computing-based distributed event-triggered consensus predictive compensation for optimal energy management in microgrid under dos attack. Mathematical Problems in Engineering, 2020(1), 1-11.
4. Zhou C, Wang L, & Wang L. (2022). Lattice-based provable data possession in the standard model for cloud-based smart grid data management systems: International Journal of Distributed Sensor Networks, 18(4), 137-147.
5. Zheng K, Wang X, & Liu J. (2020). Distributed traffic flow consolidation for power efficiency of large-scale data center network. IEEE Transactions on Cloud Computing, 2020(99), 1-1.