<span class="var-sub_title">Design of Data Management for Multi-SPMD Workflow Programming Model</span> SC18 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

ESPM2 2018: Fourth International Workshop on Extreme Scale Programming Models and Middleware


Design of Data Management for Multi-SPMD Workflow Programming Model

Abstract: As both the complexity of algorithms and architecture increase, development of scientific software becomes a challenge. In order to exploit future architecture, we consider a Multi-SPMD workflow programing model. Then, data transfer between tasks during computation highly depends on the architecture and middleware used. In this study, we design an adaptive system for data management in a parallel programming environment which can express two level of parallelism. We show how the consideration of multiple strategies based on I/O and direct message passing can improve performances and fault tolerance in the YML-XMP environment. On a real application with a sufficiently large amount of local data, speedup of 1.36 for a mixed strategy to 1.73 for a direct message passing method are obtained compared to our original design.

Archive Materials


Back to ESPM2 2018: Fourth International Workshop on Extreme Scale Programming Models and Middleware Archive Listing

Back to Full Workshop Archive Listing