Resource requirement specification for novel data-aware and workflow-enabled HPC job schedulers

Research output: Contribution to conferenceOtherpeer-review

Abstract

Technological advancements in computer architectures and the ever-increasing scope of what may be described as a hybrid HPC architecture have not been followed by relevant changes in the way jobs are described to HPC job schedulers. In this WiP, we aim to introduce an augmented job resource request (JRR) specification to be adapted by existing job scheduler implementations and used to more accurately describe the resource requirements of a job to HPC schedulers. The ultimate aim of this work is to both improve the performance of individual applications by improving the utilization of novel resources as they become available, as well as to enable the more efficient scheduling of jobs and workflows on future HPC systems.
Original languageEnglish
Number of pages1
Publication statusPublished - 2017
EventSupercomputing 2017 - Denver, United States
Duration: 13 Nov 201717 Nov 2017
http://sc17.supercomputing.org/

Conference

ConferenceSupercomputing 2017
Abbreviated titleSC17
CountryUnited States
CityDenver
Period13/11/1717/11/17
Internet address

Keywords

  • Storage class memory
  • Workflows
  • Scalability
  • NEXTGenIO
  • Resource allocation
  • SLURM
  • Portable Batch Scheduler
  • HPC
  • Systemware

Fingerprint Dive into the research topics of 'Resource requirement specification for novel data-aware and workflow-enabled HPC job schedulers'. Together they form a unique fingerprint.

Cite this