Affiliation:
1. Computer Sciences Department, University of Wisconsin, 1210 West Dayton St., Madison, WI
2. Microsoft Research, One Microsoft Way, Redmond, WA
Abstract
Hardware trends have produced an increasing disparity between processor speeds and memory access times. While a variety of techniques for tolerating or reducing memory latency have been proposed, these are rarely successful for pointer-manipulating programs.This paper explores a complementary approach that attacks the source (poor reference locality) of the problem rather than its manifestation (memory latency). It demonstrates that careful data organization and layout provides an essential mechanism to improve the cache locality of pointer-manipulating programs and consequently, their performance. It explores two placement techniques---
clustering
and
coloring
---that improve cache performance by increasing a pointer structure's spatial and temporal locality, and by reducing cache-conflicts.To reduce the cost of applying these techniques, this paper discusses two strategies---
cache-conscious reorganization
and
cache-conscious allocation
---and describes two semi-automatic tools---ccmorph and ccmalloc---that use these strategies to produce cache-conscious pointer structure layouts. ccmorph is a transparent tree reorganizer that utilizes topology information to cluster and color the structure. ccmalloc is a cache-conscious heap allocator that attempts to co-locate contemporaneously accessed data elements in the same physical cache block. Our evaluations, with microbenchmarks, several small benchmarks, and a couple of large real-world applications, demonstrate that the cache-conscious structure layouts produced by ccmorph and ccmalloc offer large performance benefits---in most cases, significantly outperforming state-of-the-art prefetching.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Graphics and Computer-Aided Design,Software
Cited by
81 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Getting a Handle on Unmanaged Memory;Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3;2024-04-27
2. MaPHeA: A Framework for Lightweight Memory Hierarchy-aware Profile-guided Heap Allocation;ACM Transactions on Embedded Computing Systems;2022-12-13
3. Software-defined address mapping: a case on 3D memory;Proceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems;2022-02-22
4. Compressed Sparse FM-Index: Fast Sequence Alignment Using Large K-Steps;IEEE/ACM Transactions on Computational Biology and Bioinformatics;2022-01-01
5. Offline and Online Algorithms for SSD Management;Proceedings of the ACM on Measurement and Analysis of Computing Systems;2021-12-14