Affiliation:
1. School of Mathematical, Physical Sciences and Energy Engineering, Hunan Institute of Technology, Hengyang, Hunan 421002, China
Abstract
Multiuser fair sharing of clusters is a classic problem in cluster construction. However, the cluster computing system for hybrid big data applications has the characteristics of heterogeneous requirements, which makes more and more cluster resource managers support fine-grained multidimensional learning resource management. In this context, it is oriented to multiusers of multidimensional learning resources. Shared clusters have become a new topic. A single consideration of a fair-shared cluster will result in a huge waste of resources in the context of discrete and dynamic resource allocation. Fairness and efficiency of cluster resource sharing for multidimensional learning resources are equally important. This paper studies big data processing technology and representative systems and analyzes multidimensional analysis and performance optimization technology. This article discusses the importance of discrete multidimensional learning resource allocation optimization in dynamic scenarios. At the same time, in view of the fact that most of the resources of the big data application cluster system are supplied to large jobs that account for a small proportion of job submissions, while the small jobs that account for a large proportion only use the characteristics of a small part of the system’s resources, the expected residual multidimensionality of large-scale work is proposed. The server with the least learning resources is allocated first, and only fair strategies are considered for small assignments. The topic index is distributed and stored on the system to realize the parallel processing of search to improve the efficiency of search processing. The effectiveness of RDIBT is verified through experimental simulation. The results show that RDIBT has higher performance than LSII index technology in index creation speed and search response speed. In addition, RDIBT can also ensure the scalability of the index system.
Subject
Multidisciplinary,General Computer Science
Reference25 articles.
1. The Stratosphere platform for big data analytics
2. Power to the People: The Role of Humans in Interactive Machine Learning
3. Reference interval for fetal biometry in Italian population;M. Giorlandino;Journal of Prenatal Medicine,2009
4. Selection of Proper Neural Network Sizes and Architectures—A Comparative Study
5. Studying learning in theworldwide classroom: research into edx’s first mooc;L. Breslow;Research &Practice in Assessment,2013
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献