Abstract
Parallel file systems deploy multiple metadata servers to distribute heavy metadata workload from clients. With the increasing number of metadata servers, metadata-intensive operations are facing some problems related with collaboration among them, compromising the performance gain. Consequently, a file system simulator is very helpful to try out some optimization ideas to solve these problems. In this paper, we propose DMFSsim to simulate the metadata-intensive operations on large-scale distributed metadata file systems. DMFSsim can flexibly replay traces of multiple metadata operations, support several commonly used metadata distribution algorithms, simulate file system tree hierarchy and underlying disk blocks management mechanism in real systems. Extensive simulations show that DMFSsim is capable of demonstrating the performance of metadata-intensive operations in distributed metadata file system.
Publisher
Trans Tech Publications, Ltd.
Reference17 articles.
1. P.H. Carns, W.B. Ligon, R.B. Ross and R. Thakur, PVFS: A parallel file system for linux clusters, Proceedings of the 4th annual Linux Showcase & Conference, Vol. 4 (2000), p.28.
2. P. Schwan, Lustre: Building a file system for 1000-node clusters, Proceedings of the 2003 Linux Symposium (2003).
3. Information on http: /www. top500. org.
4. N. Ali, A. Devulapalli, D. Dalessandro, P. Wyckoff and P. Sadayappan, Revisiting the metadata architecture of parallel file systems, Petascale Data Storage Workshop (2008), p.1.
5. Y. Zhu, H. Jiang, J. Wang and F. Xian, HBA: Distributed metadata management for large cluster-based storage systems Parallel and Distributed Systems, IEEE Transactions, Vol. 19(2008), p.750.
Cited by
5 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Hybrid Storage Management Method for Video-on-Demand Server;Advances in Intelligent Systems and Computing;2019-11-02
2. Explaining Wide Area Data Transfer Performance;Proceedings of the 26th International Symposium on High-Performance Parallel and Distributed Computing;2017-06-26
3. On the Design of Video on Demand Server-Based Hybrid Storage System;Recent Trends in Information and Communication Technology;2017-05-27
4. File Creation Optimization for Metadata-Intensive Application in File Systems;Algorithms and Architectures for Parallel Processing;2015
5. QoSFM: QoS Support for Metadata I/O in Parallel File Systems;2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing;2013-11