Type-Directed Program Synthesis and Constraint Generation for Library Portability

Bruce Collie; Philip Ginsbach; Michael O'Boyle

doi:10.1109/PACT.2019.00013

Type-Directed Program Synthesis and Constraint Generation for Library Portability

Bruce Collie, Philip Ginsbach, Michael O'Boyle

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Fast numerical libraries have been a cornerstone of scientific computing for decades, but this comes at a price. Programs may be tied to vendor specific software ecosystems resulting in polluted, non-portable code. As we enter an era of heterogeneous computing, there is an explosion in the number of accelerator libraries required to harness specialized hardware. We need a system that allows developers to exploit ever-changing accelerator libraries, without over-specializing their code.

As we cannot know the behavior of future libraries ahead of time, this paper develops a scheme that assists developers in matching their code to new libraries, without requiring the source code for these libraries. Furthermore, it can recover equivalent code from programs that use existing libraries and automatically port them to new interfaces. It first uses program synthesis to determine the meaning of a library, then maps the synthesized description into generalized constraints which are used to search the program for replacement opportunities to present to the developer.

We applied this approach to existing large applications from the scientific computing and deep learning domains. Using our approach, we show speedups ranging from 1.1× to over 10× on end to end performance when using accelerator libraries.

Original language	English
Title of host publication	2019 28th International Conference on Parallel Architectures and Compilation Techniques (PACT)
Publisher	Institute of Electrical and Electronics Engineers (IEEE)
Pages	55-67
Number of pages	13
ISBN (Electronic)	978-1-7281-3613-4
ISBN (Print)	978-1-7281-3614-1
DOIs	https://doi.org/10.1109/PACT.2019.00013
Publication status	Published - 7 Nov 2019
Event	28th International Conference on Parallel Architectures and Compilation Techniques - Seattle, United States Duration: 21 Sep 2019 → 25 Sep 2019 https://pactconf.org/

Publication series

Name
Publisher	Institute of Electrical and Electronics Engineers (IEEE)
ISSN (Print)	1089-795X
ISSN (Electronic)	2641-7936

Conference

Conference	28th International Conference on Parallel Architectures and Compilation Techniques
Abbreviated title	PACT 2019
Country/Territory	United States
City	Seattle
Period	21/09/19 → 25/09/19
Internet address	https://pactconf.org/

Keywords

C++ language
learning (artificial intelligence)
message passing
parallel programming
program compilers
software architecture
software libraries
software portability
scientific computing
type-directed program synthesis
constraint generation
library portability
vendor specific software ecosystems
heterogeneous computing
source code
Libraries
Informatics
Synthesizers
Semantics
Software
Ecosystems
Deep learning
program synthesis
code rejuvenation
constraint programming
compilers

Access to Document

10.1109/PACT.2019.00013Licence: All Rights Reserved

Type-Directed Program_COLLIE_DOA08072019_AFVAccepted author manuscript, 357 KB

https://ieeexplore.ieee.org/document/8891611Licence: All Rights Reserved

Cite this

@inproceedings{dbb2af63aa684872b0b5b7d7893d71fc,

title = "Type-Directed Program Synthesis and Constraint Generation for Library Portability",

abstract = "Fast numerical libraries have been a cornerstone of scientific computing for decades, but this comes at a price. Programs may be tied to vendor specific software ecosystems resulting in polluted, non-portable code. As we enter an era of heterogeneous computing, there is an explosion in the number of accelerator libraries required to harness specialized hardware. We need a system that allows developers to exploit ever-changing accelerator libraries, without over-specializing their code. As we cannot know the behavior of future libraries ahead of time, this paper develops a scheme that assists developers in matching their code to new libraries, without requiring the source code for these libraries. Furthermore, it can recover equivalent code from programs that use existing libraries and automatically port them to new interfaces. It first uses program synthesis to determine the meaning of a library, then maps the synthesized description into generalized constraints which are used to search the program for replacement opportunities to present to the developer. We applied this approach to existing large applications from the scientific computing and deep learning domains. Using our approach, we show speedups ranging from 1.1× to over 10× on end to end performance when using accelerator libraries.",

keywords = "C++ language, learning (artificial intelligence), message passing, parallel programming, program compilers, software architecture, software libraries, software portability, scientific computing, type-directed program synthesis, constraint generation, library portability, vendor specific software ecosystems, heterogeneous computing, source code, Libraries, Informatics, Synthesizers, Semantics, Software, Ecosystems, Deep learning, program synthesis, code rejuvenation, constraint programming, compilers",

author = "Bruce Collie and Philip Ginsbach and Michael O'Boyle",

year = "2019",

month = nov,

day = "7",

doi = "10.1109/PACT.2019.00013",

language = "English",

isbn = "978-1-7281-3614-1",

publisher = "Institute of Electrical and Electronics Engineers (IEEE)",

pages = "55--67",

booktitle = "2019 28th International Conference on Parallel Architectures and Compilation Techniques (PACT)",

address = "United States",

note = "28th International Conference on Parallel Architectures and Compilation Techniques, PACT 2019 ; Conference date: 21-09-2019 Through 25-09-2019",

url = "https://pactconf.org/",

}

Collie, B, Ginsbach, P & O'Boyle, M 2019, Type-Directed Program Synthesis and Constraint Generation for Library Portability. in 2019 28th International Conference on Parallel Architectures and Compilation Techniques (PACT). Institute of Electrical and Electronics Engineers (IEEE), pp. 55-67, 28th International Conference on Parallel Architectures and Compilation Techniques, Seattle, United States, 21/09/19. https://doi.org/10.1109/PACT.2019.00013

Type-Directed Program Synthesis and Constraint Generation for Library Portability. / Collie, Bruce; Ginsbach, Philip; O'Boyle, Michael.

2019 28th International Conference on Parallel Architectures and Compilation Techniques (PACT). Institute of Electrical and Electronics Engineers (IEEE), 2019. p. 55-67.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Type-Directed Program Synthesis and Constraint Generation for Library Portability

AU - Collie, Bruce

AU - Ginsbach, Philip

AU - O'Boyle, Michael

PY - 2019/11/7

Y1 - 2019/11/7

N2 - Fast numerical libraries have been a cornerstone of scientific computing for decades, but this comes at a price. Programs may be tied to vendor specific software ecosystems resulting in polluted, non-portable code. As we enter an era of heterogeneous computing, there is an explosion in the number of accelerator libraries required to harness specialized hardware. We need a system that allows developers to exploit ever-changing accelerator libraries, without over-specializing their code. As we cannot know the behavior of future libraries ahead of time, this paper develops a scheme that assists developers in matching their code to new libraries, without requiring the source code for these libraries. Furthermore, it can recover equivalent code from programs that use existing libraries and automatically port them to new interfaces. It first uses program synthesis to determine the meaning of a library, then maps the synthesized description into generalized constraints which are used to search the program for replacement opportunities to present to the developer. We applied this approach to existing large applications from the scientific computing and deep learning domains. Using our approach, we show speedups ranging from 1.1× to over 10× on end to end performance when using accelerator libraries.

AB - Fast numerical libraries have been a cornerstone of scientific computing for decades, but this comes at a price. Programs may be tied to vendor specific software ecosystems resulting in polluted, non-portable code. As we enter an era of heterogeneous computing, there is an explosion in the number of accelerator libraries required to harness specialized hardware. We need a system that allows developers to exploit ever-changing accelerator libraries, without over-specializing their code. As we cannot know the behavior of future libraries ahead of time, this paper develops a scheme that assists developers in matching their code to new libraries, without requiring the source code for these libraries. Furthermore, it can recover equivalent code from programs that use existing libraries and automatically port them to new interfaces. It first uses program synthesis to determine the meaning of a library, then maps the synthesized description into generalized constraints which are used to search the program for replacement opportunities to present to the developer. We applied this approach to existing large applications from the scientific computing and deep learning domains. Using our approach, we show speedups ranging from 1.1× to over 10× on end to end performance when using accelerator libraries.

KW - C++ language

KW - learning (artificial intelligence)

KW - message passing

KW - parallel programming

KW - program compilers

KW - software architecture

KW - software libraries

KW - software portability

KW - scientific computing

KW - type-directed program synthesis

KW - constraint generation

KW - library portability

KW - vendor specific software ecosystems

KW - heterogeneous computing

KW - source code

KW - Libraries

KW - Informatics

KW - Synthesizers

KW - Semantics

KW - Software

KW - Ecosystems

KW - Deep learning

KW - program synthesis

KW - code rejuvenation

KW - constraint programming

KW - compilers

U2 - 10.1109/PACT.2019.00013

DO - 10.1109/PACT.2019.00013

M3 - Conference contribution

SN - 978-1-7281-3614-1

SP - 55

EP - 67

BT - 2019 28th International Conference on Parallel Architectures and Compilation Techniques (PACT)

PB - Institute of Electrical and Electronics Engineers (IEEE)

T2 - 28th International Conference on Parallel Architectures and Compilation Techniques

Y2 - 21 September 2019 through 25 September 2019

ER -

Type-Directed Program Synthesis and Constraint Generation for Library Portability

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this