mcRPL: a general purpose parallel raster processing library on distributed heterogeneous architectures.
Saved in:
| Title: | mcRPL: a general purpose parallel raster processing library on distributed heterogeneous architectures. |
|---|---|
| Authors: | Gao, Huan1,2 (AUTHOR), Peng, Xuantong3 (AUTHOR), Guan, Qingfeng1,2 (AUTHOR), Wang, Jingyi4 (AUTHOR), Liu, Ziqi1,2 (AUTHOR), Yang, Xue1,2 (AUTHOR), Zeng, Wen1,2 (AUTHOR) |
| Source: | International Journal of Geographical Information Science. Sep2023, Vol. 37 Issue 9, p2043-2066. 24p. |
| Subjects: | Distributed computing, Library technical services, Parallel processing, Heterogeneous distributed computing, Heterogeneous computing, Parallel algorithms |
| Abstract: | Parallel computing on distributed heterogeneous architectures (e.g. computing clusters with multiple CPUs and GPUs) can significantly improve the computational efficiency and scalability of complicated algorithms, but it is theoretically and technically complex. Parallel raster processing libraries reduce the development complexity of parallel raster algorithms by hiding parallel computing details; however, no existing library sufficiently utilizes distributed heterogeneous computing resources. A general-purpose raster processing library (mcRPL) combining multi-process parallelism and multi-thread parallelism is proposed to enable parallel raster processing on distributed heterogeneous architectures with multiple CPUs and GPUs. Additionally, an adaptive hardware assignment strategy is proposed to fully utilize available processors in various hardware environments. A series of task-processing strategies are adopted to aim toward maximizing the utilization of the computing capacity of involved processors. Experiments revealed that two raster algorithms parallelized using mcRPL for spatiotemporal data fusion and land-use change simulation were 170.7- and 143.2-fold faster than original serial algorithms using 8 and 16 GPUs, respectively. While hiding the details of mixed parallelism and reducing the development complexity, mcRPL provides user-friendly interfaces for the development of parallel raster algorithms to enhance computational performance and enable large-scale raster computing tasks with extensive data volumes. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Geographical Information Science is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
Be the first to leave a comment!
