An Efficient Compiler Framework for Cache Bypassing on GPUs | |
Xie, Xiaolong ; Liang, Yun ; Sun, Guangyu ; Chen, Deming | |
2013 | |
关键词 | GPU Cache Bypassing Compiler Optimization |
英文摘要 | Graphics Processing Units (GPUs) have become ubiquitous for general purpose applications due to their tremendous computing power. Initially, GPUs only employ scratchpad memory as on-chip memory. Though scratchpad memory benefits many applications, it is not ideal for those general purpose applications with irregular memory accesses. Hence, GPU vendors have introduced caches in conjunction with scratchpad memory in the recent generations of GPUs. The caches on GPUs are highly-configurable. The programmer or the compiler can explicitly control cache access or bypass for global load instructions. This highly-configurable feature of GPU caches opens up the opportunities for optimizing the cache performance. In this paper, we propose an efficient compiler framework for cache bypassing on GPUs. Our objective is to efficiently utilize the configurable cache and improve the overall performance for general purpose GPU applications. In order to achieve this goal, we first characterize GPU cache utilization and develop performance metrics to estimate the cache reuses and memory traffic. Next, we present efficient algorithms that judiciously select global load instructions for cache access or bypass. Finally, we integrate our techniques into an automatic compiler framework that leverages PTX instruction set architecture. Experiments evaluation demonstrates that compared to cache-all and bypass-all solutions, our techniques can achieve considerable performance improvement.; Computer Science, Theory & Methods; Engineering, Electrical & Electronic; EI; CPCI-S(ISTP); 1 |
语种 | 英语 |
DOI标识 | 10.1109/ICCAD.2013.6691165 |
内容类型 | 其他 |
源URL | [http://ir.pku.edu.cn/handle/20.500.11897/405770] |
专题 | 信息科学技术学院 |
推荐引用方式 GB/T 7714 | Xie, Xiaolong,Liang, Yun,Sun, Guangyu,et al. An Efficient Compiler Framework for Cache Bypassing on GPUs. 2013-01-01. |
个性服务 |
查看访问统计 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论