CoMPI: Enhancing MPI Based Applications Performance and Scalability Using Run-Time Compression

Rosa Filgueira Vicente, David E. Singh, Alejandro Calderón, Jesús Carretero

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

This paper presents an optimization of MPI communications, called CoMPI, based on run-time compression of MPI messages exchanged by applications. A broad number of compression algorithms have been fully implemented and tested for both MPI collective and point to point primitives. In addition, this paper presents a study of several compression algorithms that can be used for run-time compression, based on the datatype used by applications. This study has been validated by using several MPI benchmarks and real HPC applications. Show that, in most of the cases, using compression reduces the application communication time enhancing application performance and scalability. In this way, CoMPI obtains important improvements in the overall execution time for many of the considered scenarios.
Original languageEnglish
Title of host publicationRecent Advances in Parallel Virtual Machine and Message Passing Interface
Subtitle of host publication16th European PVM/MPI Users’ Group Meeting, Espoo, Finland, September 7-10, 2009. Proceedings
EditorsMatti Ropo, Jan Westerholm, Jack Dongarra
Place of PublicationBerlin, Heidelberg
PublisherSpringer Berlin Heidelberg
Pages207-218
Number of pages12
ISBN (Electronic)978-3-642-03770-2
ISBN (Print)978-3-642-03769-6
DOIs
Publication statusPublished - 2009

Publication series

NameLecture Notes in Computer Science
PublisherSpringer Berlin Heidelberg
Volume5759
ISSN (Print)0302-9743

Fingerprint

Dive into the research topics of 'CoMPI: Enhancing MPI Based Applications Performance and Scalability Using Run-Time Compression'. Together they form a unique fingerprint.

Cite this