A Load-Balanced Deterministic Runtime for Pipeline Parallelism

Chen CHEN; Kai LU; Xiaoping WANG; Xu ZHOU; Zhendong WU

doi:10.1587/transinf.2014EDL8171

IEICE Transactions on Information and Systems

Online ISSN : 1745-1361
Print ISSN : 0916-8532

Regular Section

A Load-Balanced Deterministic Runtime for Pipeline Parallelism

Chen CHEN, Kai LU, Xiaoping WANG, Xu ZHOU, Zhendong WU

Author information

Keywords: deterministic runtime, pipeline parallelism, round-robin scheduling, load balance

JOURNAL FREE ACCESS

2015 Volume E98.D Issue 2 Pages 433-436

DOI https://doi.org/10.1587/transinf.2014EDL8171

Details

Abstract

Most existing deterministic multithreading systems are costly on pipeline parallel programs due to load imbalance. In this letter, we propose a Load-Balanced Deterministic Runtime (LBDR) for pipeline parallelism. LBDR deterministically takes some tokens from non-synchronization-intensive threads to synchronization-intensive threads. Experimental results show that LBDR outperforms the state-of-the-art design by an average of 22.5%.

Content from these authors

Favorites & Alerts

Corresponding author

Register with J-STAGE for free!