Applying Selectively Parallel I/O Compression to Parallel Storage Systems

Rosa Filgueira, Malcolm Atkinson, Yusuke Tanimura, Isao Kojima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

This paper presents a new I/O technique called Selectively Parallel I/O Compression (SPIOC) for providing high-speed storage and access to data in QoS enabled parallel storage systems. SPIOC reduces the time of I/O operations by applying transparent compression between the computing and the storage systems. SPIOC can predict whether to compress or not at runtime, allowing parallel or sequential compression techniques, guaranteeing QoS and allowing partial and full reading by decompressing the minimum part of the file. SPIOC maximises the measured efficiency of data movement by applying run-time customising compression before storing data in the Papio storage system.
Original languageEnglish
Title of host publicationEuro-Par 2014 Parallel Processing
Subtitle of host publication20th International Conference, Porto, Portugal, August 25-29, 2014. Proceedings
EditorsFernando Silva, Inês Dutra, Vítor Santos Costa
PublisherSpringer International Publishing
Pages282-293
Number of pages12
ISBN (Electronic)978-3-319-09873-9
ISBN (Print)978-3-319-09872-2
DOIs
Publication statusPublished - 2014

Publication series

NameLecture Notes in Computer Science
PublisherSpringer International Publishing
Volume8632
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Keywords / Materials (for Non-textual outputs)

  • Parallel File System
  • Data Intensive Computing
  • Compression algorithms
  • Adaptive systems

Fingerprint

Dive into the research topics of 'Applying Selectively Parallel I/O Compression to Parallel Storage Systems'. Together they form a unique fingerprint.

Cite this