Seastar: A Comprehensive Framework for Telemetry Data in HPC Environments

Ole Weidner, Adam Barker, Malcolm Atkinson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A large number of 2nd generation high-performance computing applications and services rely on adaptive and dynamic architectures and execution strategies to run efficiently, resiliently, and at scale on today's HPC infrastructures. They
require information about applications and their environment to steer and optimize execution. We dene this information as telemetry data.
Current HPC platforms do not provide the infrastructure, interfaces and conceptual models to collect, store, analyze, and access such data. Today, applications depend on application and platform specific techniques for collecting telemetry data; introducing significant development overheads that inhibit portability and mobility. The development and adoption of adaptive, context-aware strategies is thereby impaired. To facilitate 2nd generation applications, more efficient application development, and swift adoption of adaptive applications in production, a comprehensive framework for telemetry data management must be provided by future HPC systems and services.
We introduce Seastar, a conceptual model and a software framework to collect, store, analyze, and exploit streams of telemetry data generated by HPC systems and their applications. We show how Seastar can be integrated with HPC platform architectures and how it enables common application execution strategies.
Original languageEnglish
Title of host publicationROSS '17 Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers ROSS 2017
PublisherACM
Number of pages8
ISBN (Print)978-1-4503-5086-0
DOIs
Publication statusPublished - 27 Jun 2017
Event7th International Workshop on Runtime and Operating Systems for Supercomputers - Washington D.C, United States
Duration: 27 Jun 201727 Jun 2017
http://www.mcs.anl.gov/events/workshops/ross/2017/

Conference

Conference7th International Workshop on Runtime and Operating Systems for Supercomputers
Abbreviated titleROSS 2017
CountryUnited States
CityWashington D.C
Period27/06/1727/06/17
Internet address

Fingerprint

Dive into the research topics of 'Seastar: A Comprehensive Framework for Telemetry Data in HPC Environments'. Together they form a unique fingerprint.

Cite this