The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing

Gordon Gibb; Rupert Nash; Nicholas Brown; Bianca Prodan

doi:10.1109/UrgentHPC49580.2019.00009

The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing

Gordon Gibb, Rupert Nash, Nicholas Brown, Bianca Prodan

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract / Description of output

The use of High Performance Computing (HPC) to compliment urgent decision making in the event of disasters is an important future potential use of supercomputers. However, the usage modes involved are rather different from how HPC has been used traditionally. As such, there are many obstacles that need to be overcome, not least the unbounded wait times in the batch system queues, to make the use of HPC in disaster response practical. In this paper, we present how the VESTEC project plans to overcome these issues and develop a working prototype of an urgent computing control system. We describe the requirements for such a system and analyse the different technologies available that can be leveraged to successfully build such a system. We finally explore the design of the VESTEC system and discuss ongoing challenges that need to be addressed to realise a production level system.

Original language	English
Title of host publication	The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing
Publisher	Institute of Electrical and Electronics Engineers
Pages	24-34
Number of pages	11
ISBN (Electronic)	978-1-7281-5995-9
ISBN (Print)	978-1-7281-5996-6
DOIs	https://doi.org/10.1109/UrgentHPC49580.2019.00009
Publication status	Published - 30 Dec 2019
Event	The first international workshop on HPC for urgent decision making - Denver, United States Duration: 17 Nov 2019 → 17 Nov 2019 http://www.urgenthpc.com

Workshop

Workshop	The first international workshop on HPC for urgent decision making
Abbreviated title	UrgentHPC
Country/Territory	United States
City	Denver
Period	17/11/19 → 17/11/19
Internet address	http://www.urgenthpc.com

Access to Document

10.1109/UrgentHPC49580.2019.00009Licence: All Rights Reserved

urgent_hpcAccepted author manuscript, 628 KBLicence: All Rights Reserved

https://ieeexplore.ieee.org/document/8944962Licence: All Rights Reserved

1 Finished

VESTEC: Visual Exploration and Sampling Toolkit for Extreme Computing
Baxter, R. & Brown, N.
1/09/18 → 31/08/21
Project: Research

1 Conference contribution

The role of interactive super-computing in using HPC for urgent decision making
Brown, N., Nash, R., Gibb, G., Prodan, B., Kontak, M., Olshevsky, V. & Der Chien, W., 3 Dec 2019, High Performance Computing: ISC High Performance 2019. Weiland, M., Juckeland, G., Alam, S. & Jagode, H. (eds.). Springer, p. 528-540 14 p. ( Lecture Notes in Computer Science (LNCS); vol. 11887).
Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Open Access
File

Cite this

@inproceedings{542f87b8cb924c399be9aeae04e09eb4,

title = "The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing",

abstract = "The use of High Performance Computing (HPC) to compliment urgent decision making in the event of disasters is an important future potential use of supercomputers. However, the usage modes involved are rather different from how HPC has been used traditionally. As such, there are many obstacles that need to be overcome, not least the unbounded wait times in the batch system queues, to make the use of HPC in disaster response practical. In this paper, we present how the VESTEC project plans to overcome these issues and develop a working prototype of an urgent computing control system. We describe the requirements for such a system and analyse the different technologies available that can be leveraged to successfully build such a system. We finally explore the design of the VESTEC system and discuss ongoing challenges that need to be addressed to realise a production level system.",

author = "Gordon Gibb and Rupert Nash and Nicholas Brown and Bianca Prodan",

year = "2019",

month = dec,

day = "30",

doi = "10.1109/UrgentHPC49580.2019.00009",

language = "English",

isbn = "978-1-7281-5996-6",

pages = "24--34",

booktitle = "The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing",

publisher = "Institute of Electrical and Electronics Engineers",

address = "United States",

note = "The first international workshop on HPC for urgent decision making, UrgentHPC ; Conference date: 17-11-2019 Through 17-11-2019",

url = "http://www.urgenthpc.com",

}

Gibb, G , Nash, R , Brown, N & Prodan, B 2019, The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing. in The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing. Institute of Electrical and Electronics Engineers, pp. 24-34, The first international workshop on HPC for urgent decision making, Denver, Colorado, United States, 17/11/19. https://doi.org/10.1109/UrgentHPC49580.2019.00009

The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing. / Gibb, Gordon ; Nash, Rupert ; Brown, Nicholas et al.
The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing. Institute of Electrical and Electronics Engineers, 2019. p. 24-34.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing

AU - Gibb, Gordon

AU - Nash, Rupert

AU - Brown, Nicholas

AU - Prodan, Bianca

PY - 2019/12/30

Y1 - 2019/12/30

N2 - The use of High Performance Computing (HPC) to compliment urgent decision making in the event of disasters is an important future potential use of supercomputers. However, the usage modes involved are rather different from how HPC has been used traditionally. As such, there are many obstacles that need to be overcome, not least the unbounded wait times in the batch system queues, to make the use of HPC in disaster response practical. In this paper, we present how the VESTEC project plans to overcome these issues and develop a working prototype of an urgent computing control system. We describe the requirements for such a system and analyse the different technologies available that can be leveraged to successfully build such a system. We finally explore the design of the VESTEC system and discuss ongoing challenges that need to be addressed to realise a production level system.

AB - The use of High Performance Computing (HPC) to compliment urgent decision making in the event of disasters is an important future potential use of supercomputers. However, the usage modes involved are rather different from how HPC has been used traditionally. As such, there are many obstacles that need to be overcome, not least the unbounded wait times in the batch system queues, to make the use of HPC in disaster response practical. In this paper, we present how the VESTEC project plans to overcome these issues and develop a working prototype of an urgent computing control system. We describe the requirements for such a system and analyse the different technologies available that can be leveraged to successfully build such a system. We finally explore the design of the VESTEC system and discuss ongoing challenges that need to be addressed to realise a production level system.

U2 - 10.1109/UrgentHPC49580.2019.00009

DO - 10.1109/UrgentHPC49580.2019.00009

M3 - Conference contribution

SN - 978-1-7281-5996-6

SP - 24

EP - 34

BT - The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing

PB - Institute of Electrical and Electronics Engineers

T2 - The first international workshop on HPC for urgent decision making

Y2 - 17 November 2019 through 17 November 2019

ER -

The Technologies Required for Fusing HPC and Real-Time Data to Support Urgent Computing

Abstract / Description of output

Workshop

Access to Document

Fingerprint

Projects

VESTEC: Visual Exploration and Sampling Toolkit for Extreme Computing

Research output

The role of interactive super-computing in using HPC for urgent decision making

Cite this