International Journal of Networking and Computing
Online ISSN : 2185-2847
Print ISSN : 2185-2839
ISSN-L : 2185-2839
Special Issue on Workshop on Advances in Parallel and Distributed Computational Models 2016
Entropy of Parallel Execution and Communication
Ernesto GomezZongqi “Ritchie” CaiKeith Evan Schubert
Author information

2017 Volume 7 Issue 1 Pages 2-28


We propose a definition of parallel state, derive a phase space from this state, and calculate the entropy of states and full executions using combinatorial analysis. A main contribution of this work is the introduction of an experimentally measurable phase space, which we then use to analyze execution states, ensembles of states, and ensembles of complete executions. We show that the entropy analysis reveals both expected and unexpected features of execution, and application of principal component analysis shows capability to extract execution details at the level of individual process states, as well as reveal hardware properties such as network or memory communications.

Related papers from these authors
© 2017 International Journal of Networking and Computing
Previous article Next article