Publication: Diseño e implementación de un sistema de ficheros en MPI sobre fuse
Loading...
Identifiers
Publication date
2010-10
Defense date
2010-10-21
Authors
Advisors
Tutors
Journal Title
Journal ISSN
Volume Title
Publisher
Impact
Export
Abstract
En la actualidad la mayoría de los supercomputadores pertenecientes al Top500 utilizan sistemas de ficheros como PVFS, GPFS o Lustre. Estos sistemas de ficheros son usados mayoritariamente en aplicaciones de procesamiento de datos y visualización, intensas en datos. Sin embargo, estos sistemas presentan numerosas complicaciones a la hora de instalar y administrar. Este Proyecto Fin de Carrera presenta el diseño, implementación y evaluación de un sistema de ficheros basado en AHPIOS y FUSE. AHPIOS es el primer sistema de E/S salida paralela implementado en MPI. FUSE ofrece a los usuarios la posibilidad de desarrollar nuevos sistemas de ficheros basados en POSIX. En este trabajo se muestra como partiendo de un sistema de E/S paralela basado en MPI, se puede ofrecer una interfaz de fichero basada en POSIX. Para este fin, se ha usado la herramienta FUSE. En el capítulo de evaluación se demuestra que el prototipo implementando obtiene buenos resultados en la mayoría de los casos. Para comprobar el rendimiento del sistema propuesto se han usado distintas herramientas, basadas en aplicaciones usadas frecuentemente por la comunidad científica. ________________________________________________________________
Recent advances in storage technologies and high performance interconnects have made possible in the last years to build, more and more potent storage systems that serve thousands of nodes. The majority of storage systems of clusters and super-computers from Top 500 list are managed by one of three scalable parallel file systems: GPFS, PVFS, and Lustre. The following Master Thesis presents the design, implementation, and evaluation of a parallel file system based on AHPIOS file system and FUSE. AHPIOS is the first I/O system implemented in MPI. FUSE offers users the possibility to develop new file systems based on the POSIX interface. In this dissertation we show how starting from an existing MPI-based parallel I/O system, we are able to provide a POSIX-based interface through the FUSE tool-kit. The evaluation section shows that our implemented prototype outperforms the rest of solutions in most of the cases. In order to perform the experimental evaluation, we have been used different well-known benchmarks, which are used by the scientific community.
Recent advances in storage technologies and high performance interconnects have made possible in the last years to build, more and more potent storage systems that serve thousands of nodes. The majority of storage systems of clusters and super-computers from Top 500 list are managed by one of three scalable parallel file systems: GPFS, PVFS, and Lustre. The following Master Thesis presents the design, implementation, and evaluation of a parallel file system based on AHPIOS file system and FUSE. AHPIOS is the first I/O system implemented in MPI. FUSE offers users the possibility to develop new file systems based on the POSIX interface. In this dissertation we show how starting from an existing MPI-based parallel I/O system, we are able to provide a POSIX-based interface through the FUSE tool-kit. The evaluation section shows that our implemented prototype outperforms the rest of solutions in most of the cases. In order to perform the experimental evaluation, we have been used different well-known benchmarks, which are used by the scientific community.
Description
Keywords
Proceso en paralelo