Celebrating Diversity: A Mixture of Experts Approach for Runtime Mapping in Dynamic Environments

Murali Krishna Emani, Michael O'Boyle

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

Matching program parallelism to platform parallelism using thread selection is difficult when the environment and available resources dynamically change. Existing compiler or runtime approaches are typically based on a one-size fits all policy. There is little ability to either evaluate or adapt the policy when encountering new external workloads or hardware resources. This paper focuses on selecting the best number of threads for a parallel application in dynamic environments. It develops a new scheme based on a mixture of experts approach. It learns online which, of a number of existing policies, or experts, is best suited for a particular environment without having to try out each policy. It does this by using a novel environment predictor as a proxy for the quality of an expert thread selection policy. Additional expert policies can easily be added and are selected only when appropriate. We evaluate our scheme in environments with varying external workloads and hardware resources.We then consider the case when workloads use affinity scheduling or are themselves adaptive and show that our approach, in all cases, outperforms existing schemes and surprisingly improves workload performance. On average, we improve 1.66x over OpenMP default, 1.34x over an online scheme, 1.25x over an offline policy and 1.2x over a state-of-art analytic model. Determining the right number and type of experts is an open problem and our initial analysis shows that adding more experts improves accuracy and performance.
Original languageEnglish
Title of host publicationProceedings of the 36th ACM SIGPLAN Conference on Programming Language Design and Implementation
Place of PublicationNew York, NY, USA
Number of pages10
ISBN (Print)978-1-4503-3468-6
Publication statusPublished - 3 Jun 2015

Publication series

NamePLDI '15

Keywords / Materials (for Non-textual outputs)

  • Dynamic Environment, Machine Learning, Mixture of Experts, Parallelism Mapping


Dive into the research topics of 'Celebrating Diversity: A Mixture of Experts Approach for Runtime Mapping in Dynamic Environments'. Together they form a unique fingerprint.

Cite this