Erasure-Coded Hybrid Writes Based on Data Delta.
Saved in:
| Title: | Erasure-Coded Hybrid Writes Based on Data Delta. |
|---|---|
| Authors: | Wei, Bing1,2 (AUTHOR) weibing@buaa.edu.cn, Huang, Qiang3 (AUTHOR), Chen, Hui3 (AUTHOR), Zhang, Chenhao2 (AUTHOR), Xiao, Limin2 (AUTHOR) |
| Source: | International Journal of Parallel Programming. Aug2024, Vol. 52 Issue 4, p231-252. 22p. |
| Subjects: | Data replication, Server farms (Computer network management), Linear network coding |
| Abstract: | Erasure coding is extensively deployed in today's data centers to tackle prevalent failures, because it can offer higher reliability at lower storage overhead than data replication. However, for each small write, erasure-coded storage systems have to perform a partial write to an entire erasure coding group, resulting in a time-consuming write-after-read. This paper presents DABRI, an erasure-coded hybrid write approach based on data delta for fast partial writes. DABRI uses data deltas that are the differences between latest data values and original data values, instead of parity deltas to recover the failed data. The data node sends the latest data instead of the parity delta to parity nodes for each partial write. The original data stored on the data node is read and sent to the parity nodes, only when the data stored on the parity nodes is insufficient to maintain the data reliability. This can bypass the computation of parity deltas and reduce the number of data reads. For a series of n partial writes to the same data, DABRI performs log-based updates for data and parity in the first write, performs in-place data updates and log-based parity updates for the last n-1 writes. In addition, the I/O between data nodes and parity nodes is scheduled for parallel I/O in each partial write. We implement an erasure-coded prototype storage system based on DABRI to perform performance evaluation. Experimental results running the real-world traces show that DABRI can significantly improve the I/O throughput, compared with the state-of-the-arts. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Parallel Programming is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
Be the first to leave a comment!
