RT info:eu-repo/semantics/article T1 An Extensible System for Multilevel Automatic Data Partition and Mapping A1 Gonzalez-Escribano, Arturo A1 Torres, Yuri A1 Fresno, Javier A1 Llanos Ferraris, Diego Rafael K1 Informática K1 Data partition K1 Mapping techniques K1 Tiling K1 Parallel libraries K1 MPI K1 1203 Ciencia de Los Ordenadores K1 3304 Tecnología de Los Ordenadores AB Automatic data distribution is a key feature to obtain efficient implementations from abstract and portable parallel codes. We present a highly efficient and extensible runtime library that integrates techniques for automatic data partition and mapping. It uses a novel approach to define an abstract interface and a plug-in system to encapsulate different types of regular and irregular techniques, helping to generate codes which are independent of the exact mapping functions selected. Currently, it supports hierarchical tiling of arrays with dense and stride domains, that allows the implementation of both data and task parallelism using a SPMD model. It automatically computes appropriate domain partitions for a selected virtual topology, mapping them to available processors with static or dynamic load-balancing techniques. Our library also allows the construction of reusable communication patterns that efficiently exploit MPI communication capabilities. The use of our library greatly reduces the complexity of data distribution and communication, hiding the details of the underlying architecture. The library can be used as an abstract layer for building generic tiling operations as well. Our experimental results show that the use of this library allows to achieve similar performance as carefully-implemented manual versions for several, well-known parallel kernels and benchmarks in distributed and multicore systems, and substantially reduces programming effort. PB IEEE SN 1045-9219 YR 2014 FD 2014 LK https://uvadoc.uva.es/handle/10324/70434 UL https://uvadoc.uva.es/handle/10324/70434 LA eng NO IEEE Transactions on Parallel and Distributed Systems, Vol. 25, no. 5, May 2014, pages 1145-1154. NO Producción Científica DS UVaDOC RD 24-nov-2024