Data replication and scheduling in the cloud with optimization assisted work flow management.
Saved in:
| Title: | Data replication and scheduling in the cloud with optimization assisted work flow management. |
|---|---|
| Authors: | Rambabu, D.1 (AUTHOR) drambabu766@gmail.com, Govardhan, A.2 (AUTHOR) |
| Source: | Multimedia Tools & Applications. Aug2024, Vol. 83 Issue 27, p68883-68905. 23p. |
| Subjects: | Data replication, Workflow, Optimization algorithms, Bottlenecks (Manufacturing), K-means clustering, Scheduling, Workflow management |
| Abstract: | Data-intensive applications must be run on systems with high-performance processing and enough storage. When compared to conventional distributed systems like the data grid, cloud computing offers these features on a platform that is more flexible, scalable, and inexpensive. Moreover, retrieving data files is crucial to operate these services. Typically, accessing data causes the entire cloud workflow system to experience a bottleneck, thus significantly reducing system performance. Two key strategies that can enhance the efficiency of data-intensive applications are task scheduling and data replication. This research proposes a novel Data replication and scheduling in the cloud. Initially, the workflow management process is performed with 3 phases (1) workflow placement, (2) clustering of tasks, and (3) scheduling and replication. Initially, the workflow placement takes place. Then, the clustering of tasks is performed via an improved K-means algorithm. Finally, the tasks and datasets are replicated during the scheduling and replication phase. Further, the scheduling and replication are performed using the Self Modified Pelican Optimization Algorithm (SM-POA) based on the execution cost, migration cost, storage cost and replication. [ABSTRACT FROM AUTHOR] |
| Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Data-intensive applications must be run on systems with high-performance processing and enough storage. When compared to conventional distributed systems like the data grid, cloud computing offers these features on a platform that is more flexible, scalable, and inexpensive. Moreover, retrieving data files is crucial to operate these services. Typically, accessing data causes the entire cloud workflow system to experience a bottleneck, thus significantly reducing system performance. Two key strategies that can enhance the efficiency of data-intensive applications are task scheduling and data replication. This research proposes a novel Data replication and scheduling in the cloud. Initially, the workflow management process is performed with 3 phases (1) workflow placement, (2) clustering of tasks, and (3) scheduling and replication. Initially, the workflow placement takes place. Then, the clustering of tasks is performed via an improved K-means algorithm. Finally, the tasks and datasets are replicated during the scheduling and replication phase. Further, the scheduling and replication are performed using the Self Modified Pelican Optimization Algorithm (SM-POA) based on the execution cost, migration cost, storage cost and replication. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 13807501 |
| DOI: | 10.1007/s11042-023-17836-y |