RT info:eu-repo/semantics/article
T1 An Extensible System for Multilevel Automatic Data Partition and Mapping
A1 Gonzalez-Escribano, Arturo
A1 Torres, Yuri
A1 Fresno, Javier
A1 Llanos Ferraris, Diego Rafael
K1 Informática
K1 Data partition
K1 Mapping techniques
K1 Tiling
K1 Parallel libraries
K1 MPI
K1 1203 Ciencia de Los Ordenadores
K1 3304 Tecnología de Los Ordenadores
AB Automatic data distribution is a key feature to obtain efficient implementations from abstract and portable parallel codes. We present a highly efficient and extensible runtime library that integrates techniques for automatic data partition and mapping. It uses a novel approach to define an abstract interface and a plug-in system to encapsulate different types of regular and irregular techniques, helping to generate codes which are independent of the exact mapping functions selected. Currently, it supports hierarchical tiling of arrays with dense and stride domains, that allows the implementation of both data and task parallelism using a SPMD model. It automatically computes appropriate domain partitions for a selected virtual topology, mapping them to available processors with static or dynamic load-balancing techniques. Our library also allows the construction of reusable communication patterns that efficiently exploit MPI communication capabilities. The use of our library greatly reduces the complexity of data distribution and communication, hiding the details of the underlying architecture. The library can be used as an abstract layer for building generic tiling operations as well. Our experimental results show that the use of this library allows to achieve similar performance as carefully-implemented manual versions for several, well-known parallel kernels and benchmarks in distributed and multicore systems, and substantially reduces programming effort.
PB IEEE
SN 1045-9219
YR 2014
FD 2014
LK https://uvadoc.uva.es/handle/10324/70434
UL https://uvadoc.uva.es/handle/10324/70434
LA eng
NO IEEE Transactions on Parallel and Distributed Systems, Vol. 25, no. 5, May 2014, pages 1145-1154.
NO Producción Científica
DS UVaDOC
RD 09-nov-2024