Workflows to driving high-performance interactive supercomputing for urgent decision making

Nick Brown; Rupert Nash; Gordon Gibb; Evgenij Belikov; Artur Podobas; Wei Der Chien; Stefano Markidis; Markus  Flatken; Andreas Gerndt

Workflows to driving high-performance interactive supercomputing for urgent decision making

Nick Brown, Rupert Nash, Gordon Gibb, Evgenij Belikov, Artur Podobas, Wei Der Chien, Stefano Markidis, Markus Flatken, Andreas Gerndt

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract / Description of output

Interactive urgent computing is a small but growing user of supercomputing resources. However there are numerous technical challenges that must be overcome to make supercomputers fully suited to the wide range of urgent workloads which could benefit from the computational power delivered by such instruments. An important question is how to connect the different components of an urgent workload; namely the users, the simulation codes, and external data sources, together in a structured and accessible manner.

In this paper we explore the role of workflows from both the perspective of marshalling and control of urgent workloads, and at the individual HPC machine level. Ultimately requiring two workflow systems, by using a space weather prediction urgent use-cases, we explore the benefit that these two workflow systems provide especially when one exploits the flexibility enabled by them interoperating.

Original language	English
Title of host publication	LNCS ISC workshop proceedings
Publisher	Springer
Publication status	Accepted/In press - 2 Jun 2022
Event	Fifth Workshop on Interactive High-Performance Computing - Congress Center, Hamburg, Germany Duration: 2 Jun 2022 → … https://www.interactivehpc.com/

Workshop

Workshop	Fifth Workshop on Interactive High-Performance Computing
Abbreviated title	InteractiveHPC
Country/Territory	Germany
City	Hamburg
Period	2/06/22 → …
Internet address	https://www.interactivehpc.com/

Keywords / Materials (for Non-textual outputs)

Workflows
interactive HPC
urgent computing

Access to Document

InteractiveHPC___2022Accepted author manuscript, 474 KB

https://arxiv.org/pdf/2206.14103.pdf

VESTEC: Visual Exploration and Sampling Toolkit for Extreme Computing
Baxter, R. & Brown, N.
1/09/18 → 31/08/21
Project: Research

Cite this

@inproceedings{545e41dc35da47b1b6e8fb2a659e09e7,

title = "Workflows to driving high-performance interactive supercomputing for urgent decision making",

abstract = "Interactive urgent computing is a small but growing user of supercomputing resources. However there are numerous technical challenges that must be overcome to make supercomputers fully suited to the wide range of urgent workloads which could benefit from the computational power delivered by such instruments. An important question is how to connect the different components of an urgent workload; namely the users, the simulation codes, and external data sources, together in a structured and accessible manner. In this paper we explore the role of workflows from both the perspective of marshalling and control of urgent workloads, and at the individual HPC machine level. Ultimately requiring two workflow systems, by using a space weather prediction urgent use-cases, we explore the benefit that these two workflow systems provide especially when one exploits the flexibility enabled by them interoperating.",

keywords = "Workflows, interactive HPC, urgent computing",

author = "Nick Brown and Rupert Nash and Gordon Gibb and Evgenij Belikov and Artur Podobas and Chien, {Wei Der} and Stefano Markidis and Markus Flatken and Andreas Gerndt",

year = "2022",

month = jun,

day = "2",

language = "English",

booktitle = "LNCS ISC workshop proceedings",

publisher = "Springer",

note = "Fifth Workshop on Interactive High-Performance Computing, InteractiveHPC ; Conference date: 02-06-2022",

url = "https://www.interactivehpc.com/",

}

TY - GEN

T1 - Workflows to driving high-performance interactive supercomputing for urgent decision making

AU - Brown, Nick

AU - Nash, Rupert

AU - Gibb, Gordon

AU - Belikov, Evgenij

AU - Podobas, Artur

AU - Chien, Wei Der

AU - Markidis, Stefano

AU - Flatken, Markus

AU - Gerndt, Andreas

PY - 2022/6/2

Y1 - 2022/6/2

N2 - Interactive urgent computing is a small but growing user of supercomputing resources. However there are numerous technical challenges that must be overcome to make supercomputers fully suited to the wide range of urgent workloads which could benefit from the computational power delivered by such instruments. An important question is how to connect the different components of an urgent workload; namely the users, the simulation codes, and external data sources, together in a structured and accessible manner. In this paper we explore the role of workflows from both the perspective of marshalling and control of urgent workloads, and at the individual HPC machine level. Ultimately requiring two workflow systems, by using a space weather prediction urgent use-cases, we explore the benefit that these two workflow systems provide especially when one exploits the flexibility enabled by them interoperating.

AB - Interactive urgent computing is a small but growing user of supercomputing resources. However there are numerous technical challenges that must be overcome to make supercomputers fully suited to the wide range of urgent workloads which could benefit from the computational power delivered by such instruments. An important question is how to connect the different components of an urgent workload; namely the users, the simulation codes, and external data sources, together in a structured and accessible manner. In this paper we explore the role of workflows from both the perspective of marshalling and control of urgent workloads, and at the individual HPC machine level. Ultimately requiring two workflow systems, by using a space weather prediction urgent use-cases, we explore the benefit that these two workflow systems provide especially when one exploits the flexibility enabled by them interoperating.

KW - Workflows

KW - interactive HPC

KW - urgent computing

M3 - Conference contribution

BT - LNCS ISC workshop proceedings

PB - Springer

T2 - Fifth Workshop on Interactive High-Performance Computing

Y2 - 2 June 2022

ER -

Workflows to driving high-performance interactive supercomputing for urgent decision making

Abstract / Description of output

Workshop

Keywords / Materials (for Non-textual outputs)

Access to Document

Fingerprint

Projects

VESTEC: Visual Exploration and Sampling Toolkit for Extreme Computing

Cite this