View in EDS PDF Full Text

LANGUAGE SUPPORT FOR MULTI-PARADIGM AND MULTI-GRAIN PARALLELISM ON SMP-CLUSTER.

Saved in:
Bibliographic Details
Title: LANGUAGE SUPPORT FOR MULTI-PARADIGM AND MULTI-GRAIN PARALLELISM ON SMP-CLUSTER.
Authors: Hu, C.1, Wang, J.1 ncepu5@hotmail.com, Li, J.1 ustbljj@yahoo.com.cn
Source: International Journal of Computers & Applications. 2007, Vol. 29 Issue 2, p196-203. 8p. 4 Diagrams, 1 Chart, 2 Graphs.
Subjects: Multiparadigm programming (Computer science), Computer programming, Parallel programming, Application program interfaces, Multiprocessors
Abstract: The characteristics of large-scale parallel applications are multi-paradigm and multi-grain parallel in essence. The key factor in improving the performance of parallel application systems is to determine suitable parallel paradigms and grains according to the nature of the practical problem. Therefore, it is necessary to provide multi-paradigm and multi grain parallel programming interface for development of large-scale parallel application systems. This paper proposes a multi-paradigm and multi-grain parallel execution model integrated coarse-grain parallelism (paralleled by macro tasks), mid-grain parallelism (paralleled by basic program blocks), and fine-grain parallelism (paralleled in repetition blocks). This model also supports the task parallel, data parallel, and sequential executing. In this paper we also discuss the programming mechanism of this model by extended OpenMP specification. The extensions include computing resource partition, defining different grain task groups, mapping from task groups to the respective processor groups, out-of-core computing, asynchronous parallel I/O, and definition of sequential relationship of tasks. We compare the performance of different implementations of benchmark, using the same numerical algorithm but employ fag different programming approaches, including MPI, MPI+OpenMP, and our extended OpenMP. We also discuss a case based on SMP-Cluster and network storage architecture. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Computers & Applications is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:The characteristics of large-scale parallel applications are multi-paradigm and multi-grain parallel in essence. The key factor in improving the performance of parallel application systems is to determine suitable parallel paradigms and grains according to the nature of the practical problem. Therefore, it is necessary to provide multi-paradigm and multi grain parallel programming interface for development of large-scale parallel application systems. This paper proposes a multi-paradigm and multi-grain parallel execution model integrated coarse-grain parallelism (paralleled by macro tasks), mid-grain parallelism (paralleled by basic program blocks), and fine-grain parallelism (paralleled in repetition blocks). This model also supports the task parallel, data parallel, and sequential executing. In this paper we also discuss the programming mechanism of this model by extended OpenMP specification. The extensions include computing resource partition, defining different grain task groups, mapping from task groups to the respective processor groups, out-of-core computing, asynchronous parallel I/O, and definition of sequential relationship of tasks. We compare the performance of different implementations of benchmark, using the same numerical algorithm but employ fag different programming approaches, including MPI, MPI+OpenMP, and our extended OpenMP. We also discuss a case based on SMP-Cluster and network storage architecture. [ABSTRACT FROM AUTHOR]
ISSN:1206212X
DOI:10.1080/1206212X.2007.11441848