IEICE Electronics Express
Online ISSN : 1349-2543
ISSN-L : 1349-2543

この記事には本公開記事があります。本公開記事を参照してください。
引用する場合も本公開記事を引用してください。

Reuse Distance-Based Shared LLC Management Mechanism for Heterogeneous CPU-GPU Systems
Jiaheng LiuRyusuke EgawaKeichi TakahashiYoichi ShimomuraHiroyuki Takizawa
著者情報
ジャーナル フリー 早期公開

論文ID: 21.20230520

この記事には本公開記事があります。
詳細
抄録

Heterogeneous systems with CPU and GPU cores integrated on a single chip provide fast communication between CPU and GPU cores and high performance. The last-level cache (LLC) is one of the most essential shared memory resources in heterogeneous CPU-GPU systems. Due to the different LLC access behaviors and collaboration patterns from CPU and GPU, the shared LLC is not guaranteed to be used efficiently without any management. In this paper, we propose a reuse distance-based LLC management mechanism to improve system performance and save energy consumption. Our mechanism monitors reuse distances of cache lines accessed by CPU and GPU in sampling cache sets. It compares average reuse distance values of CPU and GPU cores to determine cache line insertion, promotion, and eviction in the LLC. Our mechanism can achieve significant performance improvement with a higher LLC hit rate. The evaluation results show that our management method can improve performance by up to 16% and 7%, and achieve LLC energy savings of up to 13% and 4% over the LRU and TAP-RRIP policies, respectively.

著者関連情報
© 2024 by The Institute of Electronics, Information and Communication Engineers
feedback
Top