HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols

Nicolai Oswald; Vijay Nagarajan; Daniel J. Sorin; Vasilis Gavrielatos; Theo Olausson; Reece Carr

doi:10.1109/HPCA53966.2022.00061

HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols

Nicolai Oswald, Vijay Nagarajan, Daniel J. Sorin, Vasilis Gavrielatos, Theo Olausson, Reece Carr

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We solve the two challenges architects face when designing heterogeneous processors with cache coherent shared memory. First, we develop an automated tool, called HeteroGen, for composing clusters of cores, each with its own coherence protocol. Second, we show that the output of HeteroGen adheres to a precisely defined memory consistency model that we call a compound consistency model. For a wide variety of protocols - including the MOESI variants, as well as those that are targeted towards Total Store Order and Release Consistency - we show that HeteroGen can correctly fuse them. To validate HeteroGen, we develop the first litmus tests for verifying that heterogeneous protocols satisfy compound consistency models. To understand the possible performance implications of automatic protocol generation, we compared against a publicly available manually-generated heterogeneous protocol. Our results show that performance is comparable.

Original language	English
Title of host publication	Proceedings - 2022 IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022
Publisher	Institute of Electrical and Electronics Engineers
Pages	756-771
Number of pages	16
ISBN (Electronic)	9781665420273
ISBN (Print)	9781665420280
DOIs	https://doi.org/10.1109/HPCA53966.2022.00061
Publication status	Published - 1 Apr 2022
Event	28th Annual IEEE International Symposium on High-Performance Computer Architecture - Virtual, Online Duration: 2 Apr 2022 → 6 Apr 2022

Publication series

Name	Proceedings - International Symposium on High-Performance Computer Architecture
Volume	2022-April
ISSN (Print)	1530-0897
ISSN (Electronic)	2378-203X

Conference

Conference	28th Annual IEEE International Symposium on High-Performance Computer Architecture
Abbreviated title	HPCA 2022
City	Virtual, Online
Period	2/04/22 → 6/04/22

Keywords / Materials (for Non-textual outputs)

Cache coherence
Compositional consistency
Compound consistency
Heterogenous coherence protocols
Litmus tests
Memory consistency
Protocol design automation

Access to Document

10.1109/HPCA53966.2022.00061Licence: All Rights Reserved

HeteroGen_OSWALD_DOA27102021_AFVAccepted author manuscript, 1.05 MBLicence: Creative Commons: Attribution (CC-BY)

https://ieeexplore.ieee.org/abstract/document/9773254Licence: All Rights Reserved

Cite this

Oswald, N., Nagarajan, V., Sorin, D. J., Gavrielatos, V., Olausson, T., & Carr, R. (2022). HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols. In Proceedings - 2022 IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022 (pp. 756-771). (Proceedings - International Symposium on High-Performance Computer Architecture; Vol. 2022-April). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/HPCA53966.2022.00061

Oswald, Nicolai ; Nagarajan, Vijay ; Sorin, Daniel J. et al. / HeteroGen : Automatic Synthesis of Heterogeneous Cache Coherence Protocols. Proceedings - 2022 IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022. Institute of Electrical and Electronics Engineers, 2022. pp. 756-771 (Proceedings - International Symposium on High-Performance Computer Architecture).

@inproceedings{90acefc16c2f4cbab004b96f475e53fb,

title = "HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols",

abstract = "We solve the two challenges architects face when designing heterogeneous processors with cache coherent shared memory. First, we develop an automated tool, called HeteroGen, for composing clusters of cores, each with its own coherence protocol. Second, we show that the output of HeteroGen adheres to a precisely defined memory consistency model that we call a compound consistency model. For a wide variety of protocols - including the MOESI variants, as well as those that are targeted towards Total Store Order and Release Consistency - we show that HeteroGen can correctly fuse them. To validate HeteroGen, we develop the first litmus tests for verifying that heterogeneous protocols satisfy compound consistency models. To understand the possible performance implications of automatic protocol generation, we compared against a publicly available manually-generated heterogeneous protocol. Our results show that performance is comparable.",

keywords = "Cache coherence, Compositional consistency, Compound consistency, Heterogenous coherence protocols, Litmus tests, Memory consistency, Protocol design automation",

author = "Nicolai Oswald and Vijay Nagarajan and Sorin, {Daniel J.} and Vasilis Gavrielatos and Theo Olausson and Reece Carr",

note = "Funding Information: This work is supported by Huawei, Google through their PhD Scholarship program, EPSRC grant EP/V028154/1 to the University of Edinburgh, and the National Science Foundation under grant CCF-200-2737. ; 28th Annual IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022 ; Conference date: 02-04-2022 Through 06-04-2022",

year = "2022",

month = apr,

day = "1",

doi = "10.1109/HPCA53966.2022.00061",

language = "English",

isbn = "9781665420280",

series = "Proceedings - International Symposium on High-Performance Computer Architecture",

publisher = "Institute of Electrical and Electronics Engineers",

pages = "756--771",

booktitle = "Proceedings - 2022 IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022",

address = "United States",

}

Oswald, N, Nagarajan, V, Sorin, DJ, Gavrielatos, V, Olausson, T & Carr, R 2022, HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols. in Proceedings - 2022 IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022. Proceedings - International Symposium on High-Performance Computer Architecture, vol. 2022-April, Institute of Electrical and Electronics Engineers, pp. 756-771, 28th Annual IEEE International Symposium on High-Performance Computer Architecture, Virtual, Online, 2/04/22. https://doi.org/10.1109/HPCA53966.2022.00061

HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols. / Oswald, Nicolai; Nagarajan, Vijay; Sorin, Daniel J. et al.
Proceedings - 2022 IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022. Institute of Electrical and Electronics Engineers, 2022. p. 756-771 (Proceedings - International Symposium on High-Performance Computer Architecture; Vol. 2022-April).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - HeteroGen

T2 - 28th Annual IEEE International Symposium on High-Performance Computer Architecture

AU - Oswald, Nicolai

AU - Nagarajan, Vijay

AU - Sorin, Daniel J.

AU - Gavrielatos, Vasilis

AU - Olausson, Theo

AU - Carr, Reece

N1 - Funding Information: This work is supported by Huawei, Google through their PhD Scholarship program, EPSRC grant EP/V028154/1 to the University of Edinburgh, and the National Science Foundation under grant CCF-200-2737.

PY - 2022/4/1

Y1 - 2022/4/1

N2 - We solve the two challenges architects face when designing heterogeneous processors with cache coherent shared memory. First, we develop an automated tool, called HeteroGen, for composing clusters of cores, each with its own coherence protocol. Second, we show that the output of HeteroGen adheres to a precisely defined memory consistency model that we call a compound consistency model. For a wide variety of protocols - including the MOESI variants, as well as those that are targeted towards Total Store Order and Release Consistency - we show that HeteroGen can correctly fuse them. To validate HeteroGen, we develop the first litmus tests for verifying that heterogeneous protocols satisfy compound consistency models. To understand the possible performance implications of automatic protocol generation, we compared against a publicly available manually-generated heterogeneous protocol. Our results show that performance is comparable.

AB - We solve the two challenges architects face when designing heterogeneous processors with cache coherent shared memory. First, we develop an automated tool, called HeteroGen, for composing clusters of cores, each with its own coherence protocol. Second, we show that the output of HeteroGen adheres to a precisely defined memory consistency model that we call a compound consistency model. For a wide variety of protocols - including the MOESI variants, as well as those that are targeted towards Total Store Order and Release Consistency - we show that HeteroGen can correctly fuse them. To validate HeteroGen, we develop the first litmus tests for verifying that heterogeneous protocols satisfy compound consistency models. To understand the possible performance implications of automatic protocol generation, we compared against a publicly available manually-generated heterogeneous protocol. Our results show that performance is comparable.

KW - Cache coherence

KW - Compositional consistency

KW - Compound consistency

KW - Heterogenous coherence protocols

KW - Litmus tests

KW - Memory consistency

KW - Protocol design automation

UR - http://www.scopus.com/inward/record.url?scp=85130710435&partnerID=8YFLogxK

U2 - 10.1109/HPCA53966.2022.00061

DO - 10.1109/HPCA53966.2022.00061

M3 - Conference contribution

AN - SCOPUS:85130710435

SN - 9781665420280

T3 - Proceedings - International Symposium on High-Performance Computer Architecture

SP - 756

EP - 771

BT - Proceedings - 2022 IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022

PB - Institute of Electrical and Electronics Engineers

Y2 - 2 April 2022 through 6 April 2022

ER -

Oswald N, Nagarajan V, Sorin DJ, Gavrielatos V, Olausson T, Carr R. HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols. In Proceedings - 2022 IEEE International Symposium on High-Performance Computer Architecture, HPCA 2022. Institute of Electrical and Electronics Engineers. 2022. p. 756-771. (Proceedings - International Symposium on High-Performance Computer Architecture). doi: 10.1109/HPCA53966.2022.00061

HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols

Abstract

Publication series

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Other files and links

Fingerprint

C6: Correct-by-Construction Heterogeneous Coherence

Cite this

HeteroGen: Automatic Synthesis of Heterogeneous Cache Coherence Protocols

Abstract

Publication series

Conference

Keywords / Materials (for Non-textual outputs)

Access to Document

Other files and links

Fingerprint

Projects

C6: Correct-by-Construction Heterogeneous Coherence

Cite this