Paving the way towards high-level parallel pattern interfaces for data stream processing

Río Astorga, David del; Dolz Zaragoza, Manuel Francisco; Fernández Muñoz, Javier; García Sánchez, José Daniel

Publication:
Paving the way towards high-level parallel pattern interfaces for data stream processing

dc.affiliation.dpto	UC3M. Departamento de Informática	es
dc.affiliation.grupoinv	UC3M. Grupo de Investigación: Arquitectura de Computadores, Comunicaciones y Sistemas	es
dc.contributor.author	Río Astorga, David del
dc.contributor.author	Dolz Zaragoza, Manuel Francisco
dc.contributor.author	Fernández Muñoz, Javier
dc.contributor.author	García Sánchez, José Daniel
dc.contributor.funder	European Commission	es
dc.contributor.funder	Ministerio de Economía y Competitividad (España)	es
dc.date.accessioned	2021-03-17T12:27:27Z
dc.date.available	2021-03-17T12:27:27Z
dc.date.issued	2018-10-01
dc.description.abstract	The emergence of the Internet of Things (IoT) data stream applications has posed a number of new challenges to existing infrastructures, processing engines, and programming models. In this sense, high-level interfaces, encapsulating algorithmic aspects in pattern-based constructions, have considerably reduced the development and parallelization efforts of this type of applications. An example of parallel pattern interface is GrPPI, a C++ generic high-level library that acts as a layer between developers and existing parallel programming frameworks, such as C++ threads, OpenMP and Intel TBB. In this paper, we complement the basic patterns supported by GrPPI with the new stream operators Split-Join and Window, and the advanced parallel patterns Stream-Pool, Windowed-Farm and Stream-Iterator for the aforementioned back ends. Thanks to these new stream operators, complex compositions among streaming patterns can be expressed. On the other hand, the collection of advanced patterns allows users to tackle some domain-specific applications, ranging from the evolutionary to the real-time computing areas, where compositions of basic patterns are not capable of fully mimicking the algorithmic behavior of their original sequential codes. The experimental evaluation of the new advanced patterns and the stream operators on a set of domain-specific use-cases, using different back ends and pattern-specific parameters, reports considerable performance gains with respect to the sequential versions. Additionally, we demonstrate the benefits of the GrPPI pattern interface from the usability, flexibility and readability points of view.	en
dc.description.sponsorship	This work was partially supported by the EU project ICT 644235 “RePhrase: REfactoring Parallel Heterogeneous Resource-Aware Applications” and the project TIN2013-41350-P “Scalable Data Management Techniques for High-End Computing Systems” from the Ministerio de Economía y Competitividad, Spain	en
dc.identifier.bibliographicCitation	Del Río Astorga, D., Dolz, M. F., Fernández, J., García, J.D., (2018). Paving the way towards highlevel parallel pattern interfaces for data stream processing. Future Generation Computer Systems, 87, pp. 228-241.	en
dc.identifier.doi	https://doi.org/10.1016/j.future.2018.05.011
dc.identifier.issn	0167-739X
dc.identifier.publicationfirstpage	228
dc.identifier.publicationlastpage	241
dc.identifier.publicationtitle	Future Generation Computer Systems-The International Journal of eScience	en
dc.identifier.publicationvolume	87
dc.identifier.uri	https://hdl.handle.net/10016/32163
dc.identifier.uxxi	AR/0000021708
dc.language.iso	eng	es
dc.publisher	Elsevier	es
dc.relation.projectID	Gobierno de España. TIN2013-41350-P	es
dc.relation.projectID	info:eu-repo/grantAgreement/644235	es
dc.rights	© 2018 Elsevier B.V. All rights reserved.	es
dc.rights	Atribución-NoComercial-SinDerivadas 3.0 España	*
dc.rights.accessRights	open access	es
dc.rights.uri	http://creativecommons.org/licenses/by-nc-nd/3.0/es/	*
dc.subject.eciencia	Informática	es
dc.subject.other	Data stream processing	en
dc.subject.other	Parallel programming framework	en
dc.subject.other	Stream operator	en
dc.subject.other	Domain-specific parallel pattern	en
dc.subject.other	High-level Api	en
dc.title	Paving the way towards high-level parallel pattern interfaces for data stream processing	en
dc.type	research article	*
dc.type.hasVersion	AM	*
dspace.entity.type	Publication