Traffic management

Author:

Dashti Mohammad1,Fedorova Alexandra1,Funston Justin1,Gaud Fabien1,Lachaize Renaud2,Lepers Baptiste3,Quema Vivien4,Roth Mark1

Affiliation:

1. Simon Fraser University, Burnaby, Canada

2. UJF, Grenoble, France

3. CNRS, Grenoble, France

4. Grenoble INP, Grenoble, France

Abstract

NUMA systems are characterized by Non-Uniform Memory Access times, where accessing data in a remote node takes longer than a local access. NUMA hardware has been built since the late 80's, and the operating systems designed for it were optimized for access locality. They co-located memory pages with the threads that accessed them, so as to avoid the cost of remote accesses. Contrary to older systems, modern NUMA hardware has much smaller remote wire delays, and so remote access costs per se are not the main concern for performance, as we discovered in this work. Instead, congestion on memory controllers and interconnects , caused by memory traffic from data-intensive applications, hurts performance a lot more. Because of that, memory placement algorithms must be redesigned to target traffic congestion. This requires an arsenal of techniques that go beyond optimizing locality. In this paper we describe Carrefour , an algorithm that addresses this goal. We implemented Carrefour in Linux and obtained performance improvements of up to 3.6 relative to the default kernel, as well as significant improvements compared to NUMA-aware patchsets available for Linux. Carrefour never hurts performance by more than 4% when memory placement cannot be improved. We present the design of Carrefour , the challenges of implementing it on modern hardware, and draw insights about hardware support that would help optimize system software on future NUMA systems.

Publisher

Association for Computing Machinery (ACM)

Subject

Computer Graphics and Computer-Aided Design,Software

Reference32 articles.

1. AMD64 Technology Lightweight Profiling Specification Aug. 2010. http://support.amd.com/us/Processor_TechDocs/43724.pdf. AMD64 Technology Lightweight Profiling Specification Aug. 2010. http://support.amd.com/us/Processor_TechDocs/43724.pdf.

2. AutoNUMA: the other approach to NUMA scheduling. LWN.net Mar. 2012. http://lwn.net/Articles/488709/. AutoNUMA: the other approach to NUMA scheduling. LWN.net Mar. 2012. http://lwn.net/Articles/488709/.

3. Handling the problems and opportunities posed by multiple on-chip memory controllers

4. The multikernel

Cited by 156 articles. 订阅此论文施引文献 订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献

1. Global-State Aware Automatic NUMA Balancing;Proceedings of the 15th Asia-Pacific Symposium on Internetware;2024-07-24

2. AdaptMD: Balancing Space and Performance in NUMA Architectures With Adaptive Memory Deduplication;IEEE Transactions on Computers;2024-06

3. A unified hybrid memory system for scalable deep learning and big data applications;Journal of Parallel and Distributed Computing;2024-04

4. ABSS: An Adaptive Batch-Stream Scheduling Module for Dynamic Task Parallelism on Chiplet-based Multi-Chip Systems;ACM Transactions on Parallel Computing;2024-03-11

5. GRIT: Enhancing Multi-GPU Performance with Fine-Grained Dynamic Page Placement;2024 IEEE International Symposium on High-Performance Computer Architecture (HPCA);2024-03-02

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3