RT info:eu-repo/semantics/conferenceObject
T1 Encapsulated synchronization and load-balance in heterogeneous programming
A1 Torres de la Sierra, Yuri
A1 Llanos Ferraris, Diego Rafael
A1 González Escribano, Arturo
A1 Llanos, Diego
K1 Informática
K1 1203 Ciencia de Los Ordenadores
K1 3304 Tecnología de Los Ordenadores
AB Programming models and techniques to exploit parallelism in accelerators, such as GPUs, are different from those used in traditional parallel models for shared- or distributed-memory systems. It is a challenge to blend different programming models to coordinate and exploit devices with very different characteristics and computation powers. This paper presents a new extensible framework model to encapsulate run-time decisions related to data partition, granularity, load balance, synchronization, and communication for systems including assorted GPUs. Thus, the main parallel code becomes independent of them, using internal topology and system information to transparently adapt the computation to the system. The programmer can develop specific functions for each architecture, or use existent specialized library functions for different CPU-core or GPU architectures. The high-level coordination is expressed using a programming model built on top of message-passing, providing portability across distributed- or shared-memory systems. We show with an example how to produce a parallel code that can be used to efficiently run on systems ranging from a Beowulf cluster to a machine with mixed GPUs. Our experimental results show how the run-time system, guided by hints about the computational-power ratios of different devices, can automatically part and distribute large computations across heterogeneous systems, improving the overall performance.
PB Springer
YR 2012
FD 2012
LK https://uvadoc.uva.es/handle/10324/70779
UL https://uvadoc.uva.es/handle/10324/70779
LA eng
NO 18th International Conference, Euro-Par 2012, Rhodes Island, Greece, August 27-31, 2012, pp 502-513
NO Producción Científica
DS UVaDOC
RD 26-nov-2024