Publication:
Evaluating data caching techniques in DMCF workflows using Hercules

Simple item page
dc.affiliation.dptoUC3M. Departamento de Informáticaes
dc.affiliation.grupoinvUC3M. Grupo de Investigación: Arquitectura de Computadores, Comunicaciones y Sistemases
dc.contributor.authorRodrigo Duro, Francisco José
dc.contributor.authorMarozzo, Fabrizio
dc.contributor.authorGarcía Blas, Javier
dc.contributor.authorCarretero Pérez, Jesús
dc.contributor.authorTalia, Domenico
dc.contributor.authorTrunfio, Paolo
dc.date.accessioned2015-11-18T09:57:26Z
dc.date.available2015-11-18T09:57:26Z
dc.date.issued2015-10
dc.description.abstractThe Data Mining Cloud Framework (DMCF) is an environment for designing and executing data analysis workflows in cloud platforms. Currently, DMCF relies on the default storage of the public cloud provider for any I/O related operation. This implies that the I/O performance of DMCF is limited by the performance of the default storage. In this work we propose the usage of the Hercules system within DMCF as an ad-hoc storage system for temporary data produced inside workflow-based applications. Hercules is a distributed in-memory storage system highly scalable and easy to deploy. The proposed solution takes advantage of the scalability capabilities of Hercules to avoid the bandwidth limits of the default storage. Early experimental results are presented in this paper, they show promising performance, particularly for write operations, compared to the performance obtained using the default storage services.en
dc.description.sponsorshipThis work is partially supported by EU under the COST Program Action IC1305: Network for Sustainable Ultrascale Computing (NESUS). This work is partially supported by the grant TIN2013-41350-P, Scalable Data Management Techniques for High-End Computing Systems from the Spanish Ministry of Economy and Competitiveness.en
dc.format.extent12
dc.format.mimetypeapplication/pdf
dc.identifier.bibliographicCitationCarretero Pérez, Jesús; et.al. (eds.). (2015) Proceedings of the Second International Workshop on Sustainable Ultrascale Computing Systems (NESUS 2015): Krakow, Poland. Universidad Carlos III de Madrid, pp. 95-106.en
dc.identifier.isbn978-84-608-2581-4
dc.identifier.publicationfirstpage95
dc.identifier.publicationlastpage106
dc.identifier.publicationtitleProceedings of the Second International Workshop on Sustainable Ultrascale Computing Systems (NESUS 2015): Krakow, Polanden
dc.identifier.urihttps://hdl.handle.net/10016/22027
dc.identifier.uxxiCC/0000024008
dc.language.isoeng
dc.relation.eventdateSeptember 10-11, 2015en
dc.relation.eventnumber2
dc.relation.eventplaceKrakow, Polanden
dc.relation.eventtitleInternational Workshop on Sustainable Ultrascale Computing Systems (NESUS 2015)en
dc.relation.projectIDGobierno de España. TIN2013-41350-P
dc.rights.accessRightsopen access
dc.subject.ecienciaInformáticaes
dc.subject.otherDMCFen
dc.subject.otherHerculesen
dc.subject.otherData analysisen
dc.subject.otherWorkflowsen
dc.subject.otherIn-memory storageen
dc.subject.otherMicrosoft Azureen
dc.titleEvaluating data caching techniques in DMCF workflows using Herculesen
dc.typeconference paper*
dc.type.hasVersionVoR*
dspace.entity.typePublication
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
evaluating_NESUS_2015.pdf
Size:
1.37 MB
Format:
Adobe Portable Document Format
Download
Collections
Second International Workshop on Sustainable Ultrascale Computing Systems (NESUS 2015)