Data replication and scheduling in the cloud with optimization assisted work flow management.

Saved in:
Bibliographic Details
Title: Data replication and scheduling in the cloud with optimization assisted work flow management.
Authors: Rambabu, D.1 (AUTHOR) drambabu766@gmail.com, Govardhan, A.2 (AUTHOR)
Source: Multimedia Tools & Applications. Aug2024, Vol. 83 Issue 27, p68883-68905. 23p.
Subjects: Data replication, Workflow, Optimization algorithms, Bottlenecks (Manufacturing), K-means clustering, Scheduling, Workflow management
Abstract: Data-intensive applications must be run on systems with high-performance processing and enough storage. When compared to conventional distributed systems like the data grid, cloud computing offers these features on a platform that is more flexible, scalable, and inexpensive. Moreover, retrieving data files is crucial to operate these services. Typically, accessing data causes the entire cloud workflow system to experience a bottleneck, thus significantly reducing system performance. Two key strategies that can enhance the efficiency of data-intensive applications are task scheduling and data replication. This research proposes a novel Data replication and scheduling in the cloud. Initially, the workflow management process is performed with 3 phases (1) workflow placement, (2) clustering of tasks, and (3) scheduling and replication. Initially, the workflow placement takes place. Then, the clustering of tasks is performed via an improved K-means algorithm. Finally, the tasks and datasets are replicated during the scheduling and replication phase. Further, the scheduling and replication are performed using the Self Modified Pelican Optimization Algorithm (SM-POA) based on the execution cost, migration cost, storage cost and replication. [ABSTRACT FROM AUTHOR]
Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Full text is not displayed to guests.
Description
Abstract:Data-intensive applications must be run on systems with high-performance processing and enough storage. When compared to conventional distributed systems like the data grid, cloud computing offers these features on a platform that is more flexible, scalable, and inexpensive. Moreover, retrieving data files is crucial to operate these services. Typically, accessing data causes the entire cloud workflow system to experience a bottleneck, thus significantly reducing system performance. Two key strategies that can enhance the efficiency of data-intensive applications are task scheduling and data replication. This research proposes a novel Data replication and scheduling in the cloud. Initially, the workflow management process is performed with 3 phases (1) workflow placement, (2) clustering of tasks, and (3) scheduling and replication. Initially, the workflow placement takes place. Then, the clustering of tasks is performed via an improved K-means algorithm. Finally, the tasks and datasets are replicated during the scheduling and replication phase. Further, the scheduling and replication are performed using the Self Modified Pelican Optimization Algorithm (SM-POA) based on the execution cost, migration cost, storage cost and replication. [ABSTRACT FROM AUTHOR]
ISSN:13807501
DOI:10.1007/s11042-023-17836-y