Affiliation:
1. Hewlett--Packard Laboratories, Palo Alto, CA
Abstract
Enterprise-scale storage systems, which can contain hundreds of host computers and storage devices and up to tens of thousands of disks and logical volumes, are difficult to design. The volume of choices that need to be made is massive, and many choices have unforeseen interactions. Storage system design is tedious and complicated to do by hand, usually leading to solutions that are grossly over-provisioned, substantially under-performing or, in the worst case, both.To solve the configuration nightmare, we present minerva: a suite of tools for designing storage systems automatically. Minerva uses declarative specifications of application requirements and device capabilities; constraint-based formulations of the various sub-problems; and optimization techniques to explore the search space of possible solutions.This paper also explores and evaluates the design decisions that went into Minerva, using specialized micro- and macro-benchmarks. We show that Minerva can successfully handle a workload with substantial complexity (a decision-support database benchmark). Minerva created a 16-disk design in only a few minutes that achieved the same performance as a 30-disk system manually designed by human experts. Of equal importance, Minerva was able to predict the resulting system's performance before it was built.
Publisher
Association for Computing Machinery (ACM)
Reference23 articles.
1. 3COM CORP. 1996. Gigabit Ethernet comes of age. 3Com Corporation. Technology white paper. 3COM CORP. 1996. Gigabit Ethernet comes of age. 3Com Corporation. Technology white paper.
2. ANSI. 1996. Fibre Channel Arbitrated Loop. ANSI. Standard X3.272-1996. ANSI. 1996. Fibre Channel Arbitrated Loop. ANSI. Standard X3.272-1996.
3. A genetic algorithm for the generalised assignment problem
Cited by
99 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. SkyPIE: A Fast & Accurate Oracle for Object Placement;Proceedings of the ACM on Management of Data;2024-03-12
2. Mimir: Finding Cost-efficient Storage Configurations in the Public Cloud;Proceedings of the 16th ACM International Conference on Systems and Storage;2023-06-05
3. Bibliography;Storage Systems;2022
4. Heterogeneous Disk Arrays - HDAs;Storage Systems;2022
5. A Reinforcement Learning Based System for Minimizing Cloud Storage Service Cost;49th International Conference on Parallel Processing - ICPP;2020-08-17