Edinburgh Research Explorer

Mitigating JIT Compilation Latency in Virtual Execution Environments

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Related Edinburgh Organisations

Open Access permissions

Open

Documents

https://dl.acm.org/citation.cfm?id=3313818
Original languageEnglish
Title of host publicationProceedings of the 15th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments
PublisherAssociation for Computing Machinery (ACM)
Pages101-107
Number of pages7
ISBN (Print)978-1-4503-6020-3
DOIs
Publication statusPublished - 14 Apr 2019
Event15th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments - Providence, United States
Duration: 14 Apr 201914 Apr 2019
https://conf.researchr.org/home/vee-2019

Conference

Conference15th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments
Abbreviated titleVEE'19
CountryUnited States
CityProvidence
Period14/04/1914/04/19
Internet address

Abstract

Many Virtual Execution Environments (VEEs) rely on Justin-time (JIT) compilation technology for code generation at runtime, e.g. in Dynamic Binary Translation (DBT) systems or language Virtual Machines (VMs). While JIT compilation improves native execution performance as opposed to e.g. interpretive execution, the JIT compilation process itself introduces latency. In fact, for highly optimizing JIT compilers or compilers not specifically designed for JIT compilation, e.g. LLVM, this latency can cause a substantial overhead. While existing work has introduced asynchronously decoupled JIT compilation task farms to hide this JIT compilation latency, we show that this on its own is not sufficient to mitigate the impact of JIT compilation latency on overall performance. In this paper, we introduce a novel JIT compilation scheduling policy, which performs continuous low-cost profiling of code regions already dispatched for JIT compilation, right up to the point where compilation commences. We have integrated our novel JIT compilation scheduling approach into a commercial LLVM-based DBT system and demonstrate speedups of 1.32× on average, and up to 2.31×, over its state-of-the-art concurrent task-farm based JIT compilation scheme across the SPEC CPU2006 and BioPerf benchmark suites.

    Research areas

  • simulation and emulation, simulator / interpreter, just-in-time compliers, JIT compilation, performance, compilation latency, scheduling

Event

15th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

14/04/1914/04/19

Providence, United States

Event: Conference

Download statistics

No data available

ID: 79795322