Publication:
Combining malleability and I/O control mechanisms to enhance the execution of multiple applications

dc.affiliation.dptoUC3M. Departamento de Informáticaes
dc.affiliation.grupoinvUC3M. Grupo de Investigación: Arquitectura de Computadores, Comunicaciones y Sistemases
dc.contributor.authorExpósito Singh, David
dc.contributor.authorCarretero Pérez, Jesús
dc.contributor.funderEuropean Commissionen
dc.contributor.funderMinisterio de Economía y Competitividad (España)es
dc.date.accessioned2021-12-17T12:52:41Z
dc.date.available2021-12-17T12:52:41Z
dc.date.issued2019-02-01
dc.description.abstractThis work presents a common framework that integrates CLARISSE, a cross-layer runtime for the I/O software stack, and FlexMPI, a runtime that provides dynamic load balancing and malleability capabilities for MPI applications. This integration is performed both at application level, as libraries executed within the application, as well as at central-controller level, as external components that manage the execution of different applications. We show that a cooperation between both runtimes provides important benefits for overall system performance: first, by means of monitoring, the CPU, communication and I/O performances of all executing applications are collected, providing a holistic view of the complete platform utilization. Secondly, we introduce a coordinated way of using CLARISSE and FlexMPI control mechanisms, based on two different optimization strategies, with the aim of improving both the application I/O and overall system performance. Finally, we present a detailed description of this proposal, as well as an empirical evaluation of the framework on a cluster showing significant performance improvements at both application and wide-platform levels. We demonstrate that with this proposal the overall I/O time of an application can be reduced by up to 49% and the aggregated FLOPS of all running applications can be increased by 10% with respect to the baseline case. (C) 2018 Elsevier Inc. All rights reserved.en
dc.description.sponsorshipThe author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work has been partially supported by the Spanish “Ministerio de Economia y Competitividad” under the project grant TIN2016-79637-P “Towards Unification of HPC and Big Data paradigms” and EU under the COST Program Action IC1305, Network for Sustainable Ultrascale Computing (NESUS).en
dc.identifier.bibliographicCitationSingh, D. E., Carretero, J. (2019). Combining malleability and I/O control mechanisms to enhance the execution of multiple applications. The Journal of Systems and Software, 148, pp. 21-36. https://doi.org/10.1016/j.jss.2018.11.006en
dc.identifier.doihttps://doi.org/10.1016/j.jss.2018.11.006
dc.identifier.issn0164-1212
dc.identifier.publicationfirstpage21
dc.identifier.publicationlastpage36
dc.identifier.publicationtitleJOURNAL OF SYSTEMS AND SOFTWAREen
dc.identifier.publicationvolume148
dc.identifier.urihttps://hdl.handle.net/10016/33793
dc.identifier.uxxiAR/0000022918
dc.language.isoengen
dc.publisherElsevieren
dc.relation.projectIDinfo:eu-repo/grantAgreement/EC/Accion COST IC1305
dc.relation.projectIDGobierno de España. TIN2016-79637-Pes
dc.rights© 2018 Elsevier Inc. All rights reserved.en
dc.rightsAtribución-NoComercial-SinDerivadas 3.0 España
dc.rights.accessRightsopen accessen
dc.rights.urihttp://creativecommons.org/licenses/by-nc-nd/3.0/es/
dc.subject.ecienciaInformáticaes
dc.subject.othermalleabilityen
dc.subject.otheri/o schedulingen
dc.subject.othermpi hight-performance computingen
dc.subject.othercross-layer optimizationsen
dc.subject.otherparallel I/Oen
dc.subject.othermiddlewareen
dc.subject.otherperformanceen
dc.titleCombining malleability and I/O control mechanisms to enhance the execution of multiple applicationsen
dc.typeresearch article*
dc.type.hasVersionAM*
dspace.entity.typePublication
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
combining_JSS_2019_ps.pdf
Size:
3.31 MB
Format:
Adobe Portable Document Format
Description: