Applying Selectively Parallel I/O Compression to Parallel Storage Systems

Rosa Filgueira; Malcolm Atkinson; Yusuke Tanimura; Isao Kojima

doi:10.1007/978-3-319-09873-9_24

Applying Selectively Parallel I/O Compression to Parallel Storage Systems

Rosa Filgueira, Malcolm Atkinson, Yusuke Tanimura, Isao Kojima

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper presents a new I/O technique called Selectively Parallel I/O Compression (SPIOC) for providing high-speed storage and access to data in QoS enabled parallel storage systems. SPIOC reduces the time of I/O operations by applying transparent compression between the computing and the storage systems. SPIOC can predict whether to compress or not at runtime, allowing parallel or sequential compression techniques, guaranteeing QoS and allowing partial and full reading by decompressing the minimum part of the file. SPIOC maximises the measured efficiency of data movement by applying run-time customising compression before storing data in the Papio storage system.

Original language	English
Title of host publication	Euro-Par 2014 Parallel Processing
Subtitle of host publication	20th International Conference, Porto, Portugal, August 25-29, 2014. Proceedings
Editors	Fernando Silva, Inês Dutra, Vítor Santos Costa
Publisher	Springer
Pages	282-293
Number of pages	12
ISBN (Electronic)	978-3-319-09873-9
ISBN (Print)	978-3-319-09872-2
DOIs	https://doi.org/10.1007/978-3-319-09873-9_24
Publication status	Published - 2014

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer International Publishing
Volume	8632
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Keywords / Materials (for Non-textual outputs)

Parallel File System
Data Intensive Computing
Compression algorithms
Adaptive systems

Access to Document

10.1007/978-3-319-09873-9_24

https://link.springer.com/chapter/10.1007%2F978-3-319-09873-9_24

EFFORT (Earthquake and Failure FOrecasting in Real Time): Hazard forecasting in real time
Main, I. (Principal Investigator), Atkinson, M. (Co-investigator), Bell, A. (Researcher) & Filgueira, R. (Researcher)
NERC
1/01/11 → 30/06/14
Project: Research

Rosa Filgueira
- EPCC - Chancellor's Fellow - AI & Datascience
Person: Academic: Research Active

Cite this

Filgueira, R., Atkinson, M., Tanimura, Y., & Kojima, I. (2014). Applying Selectively Parallel I/O Compression to Parallel Storage Systems. In F. Silva, I. Dutra, & V. Santos Costa (Eds.), Euro-Par 2014 Parallel Processing: 20th International Conference, Porto, Portugal, August 25-29, 2014. Proceedings (pp. 282-293). (Lecture Notes in Computer Science; Vol. 8632). Springer. https://doi.org/10.1007/978-3-319-09873-9_24

Filgueira, Rosa ; Atkinson, Malcolm ; Tanimura, Yusuke et al. / Applying Selectively Parallel I/O Compression to Parallel Storage Systems. Euro-Par 2014 Parallel Processing: 20th International Conference, Porto, Portugal, August 25-29, 2014. Proceedings. editor / Fernando Silva ; Inês Dutra ; Vítor Santos Costa. Springer, 2014. pp. 282-293 (Lecture Notes in Computer Science).

@inproceedings{3ef09e303b75442a98debb5181859d78,

title = "Applying Selectively Parallel I/O Compression to Parallel Storage Systems",

abstract = "This paper presents a new I/O technique called Selectively Parallel I/O Compression (SPIOC) for providing high-speed storage and access to data in QoS enabled parallel storage systems. SPIOC reduces the time of I/O operations by applying transparent compression between the computing and the storage systems. SPIOC can predict whether to compress or not at runtime, allowing parallel or sequential compression techniques, guaranteeing QoS and allowing partial and full reading by decompressing the minimum part of the file. SPIOC maximises the measured efficiency of data movement by applying run-time customising compression before storing data in the Papio storage system.",

keywords = "Parallel File System, Data Intensive Computing, Compression algorithms, Adaptive systems",

author = "Rosa Filgueira and Malcolm Atkinson and Yusuke Tanimura and Isao Kojima",

year = "2014",

doi = "10.1007/978-3-319-09873-9_24",

language = "English",

isbn = "978-3-319-09872-2",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "282--293",

editor = "Fernando Silva and In{\^e}s Dutra and {Santos Costa}, V{\'i}tor",

booktitle = "Euro-Par 2014 Parallel Processing",

address = "United Kingdom",

}

Filgueira, R, Atkinson, M, Tanimura, Y & Kojima, I 2014, Applying Selectively Parallel I/O Compression to Parallel Storage Systems. in F Silva, I Dutra & V Santos Costa (eds), Euro-Par 2014 Parallel Processing: 20th International Conference, Porto, Portugal, August 25-29, 2014. Proceedings. Lecture Notes in Computer Science, vol. 8632, Springer, pp. 282-293. https://doi.org/10.1007/978-3-319-09873-9_24

Applying Selectively Parallel I/O Compression to Parallel Storage Systems. / Filgueira, Rosa; Atkinson, Malcolm; Tanimura, Yusuke et al.
Euro-Par 2014 Parallel Processing: 20th International Conference, Porto, Portugal, August 25-29, 2014. Proceedings. ed. / Fernando Silva; Inês Dutra; Vítor Santos Costa. Springer, 2014. p. 282-293 (Lecture Notes in Computer Science; Vol. 8632).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Applying Selectively Parallel I/O Compression to Parallel Storage Systems

AU - Filgueira, Rosa

AU - Atkinson, Malcolm

AU - Tanimura, Yusuke

AU - Kojima, Isao

PY - 2014

Y1 - 2014

N2 - This paper presents a new I/O technique called Selectively Parallel I/O Compression (SPIOC) for providing high-speed storage and access to data in QoS enabled parallel storage systems. SPIOC reduces the time of I/O operations by applying transparent compression between the computing and the storage systems. SPIOC can predict whether to compress or not at runtime, allowing parallel or sequential compression techniques, guaranteeing QoS and allowing partial and full reading by decompressing the minimum part of the file. SPIOC maximises the measured efficiency of data movement by applying run-time customising compression before storing data in the Papio storage system.

AB - This paper presents a new I/O technique called Selectively Parallel I/O Compression (SPIOC) for providing high-speed storage and access to data in QoS enabled parallel storage systems. SPIOC reduces the time of I/O operations by applying transparent compression between the computing and the storage systems. SPIOC can predict whether to compress or not at runtime, allowing parallel or sequential compression techniques, guaranteeing QoS and allowing partial and full reading by decompressing the minimum part of the file. SPIOC maximises the measured efficiency of data movement by applying run-time customising compression before storing data in the Papio storage system.

KW - Parallel File System

KW - Data Intensive Computing

KW - Compression algorithms

KW - Adaptive systems

U2 - 10.1007/978-3-319-09873-9_24

DO - 10.1007/978-3-319-09873-9_24

M3 - Conference contribution

SN - 978-3-319-09872-2

T3 - Lecture Notes in Computer Science

SP - 282

EP - 293

BT - Euro-Par 2014 Parallel Processing

A2 - Silva, Fernando

A2 - Dutra, Inês

A2 - Santos Costa, Vítor

PB - Springer

ER -

Filgueira R, Atkinson M, Tanimura Y, Kojima I. Applying Selectively Parallel I/O Compression to Parallel Storage Systems. In Silva F, Dutra I, Santos Costa V, editors, Euro-Par 2014 Parallel Processing: 20th International Conference, Porto, Portugal, August 25-29, 2014. Proceedings. Springer. 2014. p. 282-293. (Lecture Notes in Computer Science). doi: 10.1007/978-3-319-09873-9_24

Applying Selectively Parallel I/O Compression to Parallel Storage Systems

Abstract

Publication series

Keywords / Materials (for Non-textual outputs)

Access to Document

Fingerprint

Projects

EFFORT (Earthquake and Failure FOrecasting in Real Time): Hazard forecasting in real time

Profiles

Rosa Filgueira

Cite this