Por favor, use este identificador para citar o enlazar este ítem:https://uvadoc.uva.es/handle/10324/75227
Título
An autotuning approach to select the inter-GPU communication library on heterogeneous systems
Año del Documento
2024
Editorial
Springer
Descripción
Producción Científica
Documento Fuente
The Journal of Supercomputing, 2024, vol. 81, n. 1
Resumen
In this work, an automatic optimisation approach for parallel routines on multi-GPU
systems is presented. Several inter-GPU communication libraries (such as CUDA-
Aware MPI or NCCL) are used with a set of routines to perform the numerical oper-
ations among the GPUs located on the compute nodes. The main objective is the
selection of the most appropriate communication library, the number of GPUs to be
used and the workload to be distributed among them in order to reduce the cost of
data movements, which represent a large percentage of the total execution time. To
this end, a hierarchical modelling of the execution time of each routine to be opti-
mised is proposed, combining experimental and theoretical approaches. The results
show that near-optimal decisions are taken in all the scenarios analysed.
Materias Unesco
1203.17 Informática
Palabras Clave
Autotuning
Communication libraries
Multi-GPU
Heterogeneous computing
ISSN
0920-8542
Revisión por pares
SI
Patrocinador
Publicación en abierto financiada por el Consorcio de Bibliotecas Universitarias de Castilla y León (BUCLE), con cargo al Programa Operativo 2014ES16RFOP009 FEDER 2014-2020 DE CASTILLA Y LEÓN, Actuación:20007-CL - Apoyo Consorcio BUCLE
This work is supported by Grant PID2022-136315OB-I00 and Grant PID2022-142292NB-I00, both funded by MCIN/AEI/10.13039/501100011033/ and by “ERDF A way of making Europe”, EU
This work is supported by Grant PID2022-136315OB-I00 and Grant PID2022-142292NB-I00, both funded by MCIN/AEI/10.13039/501100011033/ and by “ERDF A way of making Europe”, EU
Version del Editor
Propietario de los Derechos
© 2024 The Author(s)
Idioma
eng
Tipo de versión
info:eu-repo/semantics/publishedVersion
Derechos
openAccess
Aparece en las colecciones
Ficheros en el ítem
