View in EDS PDF Full Text

REMOTE MPI-I/O ON A PARALLEL VIRTUAL FILE SYSTEM USING A CIRCULAR BUFFER FOR HIGH THROUGHPUT.

Saved in:
Bibliographic Details
Title: REMOTE MPI-I/O ON A PARALLEL VIRTUAL FILE SYSTEM USING A CIRCULAR BUFFER FOR HIGH THROUGHPUT.
Authors: Tsujita, Y.1 tsujita@hiro.kindai.ac.jp
Source: International Journal of Computers & Applications. 2007, Vol. 29 Issue 3, p291-299. 9p.
Subjects: Remote computing, Unix operating systems, Buffer storage (Computer science), Cache memory, Computer operating systems
Abstract: A flexible intermediate library named Stampi realizes seamless remote MPI-I/O operations on interconnected computers with the help of its MPI-I/O process which is invoked on a remote computer. The MPI-I/O process carries out I/O operations by using vendor's MPI-I/O library according to I/O requests from user processes. If the vendor's one is not available, UNIX I/O functions are used instead of it. A parallel virtual file system (PVFS) was supported in the remote MPI-I/O mechanism for data-intensive applications. Although this mechanism provided parallel I/0 operations on a PVFS file system, its performance with UNIX I/O functions was low. Attempts to obtain high throughput have been made for this case with adopting a circular buffer mechanism in the MPI-I/O process to cache a part of or whole data. By optimizing configuration of the buffer, remote MPI-I/O operations with UNIX I/O functions outperformed those with direct calls of PVFS I/O functions on a PVFS file system. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Computers & Applications is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:A flexible intermediate library named Stampi realizes seamless remote MPI-I/O operations on interconnected computers with the help of its MPI-I/O process which is invoked on a remote computer. The MPI-I/O process carries out I/O operations by using vendor's MPI-I/O library according to I/O requests from user processes. If the vendor's one is not available, UNIX I/O functions are used instead of it. A parallel virtual file system (PVFS) was supported in the remote MPI-I/O mechanism for data-intensive applications. Although this mechanism provided parallel I/0 operations on a PVFS file system, its performance with UNIX I/O functions was low. Attempts to obtain high throughput have been made for this case with adopting a circular buffer mechanism in the MPI-I/O process to cache a part of or whole data. By optimizing configuration of the buffer, remote MPI-I/O operations with UNIX I/O functions outperformed those with direct calls of PVFS I/O functions on a PVFS file system. [ABSTRACT FROM AUTHOR]
ISSN:1206212X
DOI:10.1080/1206212X.2007.11441859