FITDOC: fast virtual machines checkpointing with delta memory compression.
Saved in:
| Title: | FITDOC: fast virtual machines checkpointing with delta memory compression. |
|---|---|
| Authors: | Du, Yunjie1, Shi, Xuanhua1 xhshi@hust.edu.cn, Jin, Hai1, Wu, Song1, Yang, Laurence |
| Source: | Journal of Supercomputing. Sep2016, Vol. 72 Issue 9, p3328-3347. 20p. |
| Subjects: | Bit-mapped graphics, Virtual machine systems, Digital computer simulation, Computer graphics, Data logging |
| Abstract: | Virtualization provides the function of saving the entire status of the execution environment of a running virtual machine (VM), which makes checkpointing flexible and practical for HPC servers or data center servers. However, the system-level checkpointing needs to save a large number of data to the disk. Moreover, the overhead grows linearly with the increasing size of virtual machine memory, which leads to disk I/O consumption disaster along with poor system scalability. To target this, we propose a novel fast VM checkpointing approach, named Fast Incremental checkpoinTing with Delta memOry Compression (FITDOC). By studying the run-time memory characteristics of different workloads, FITDOC counts the dirty pages in a fine-granularity manner (i.e., the number of 8 bytes), instead of in the conventional method (i.e., the number of pages). FITDOC utilises a dirty page logging mechanism to record the dirty pages. Accordingly, a delta memory compression mechanism is implemented to eliminate redundant memory data in checkpointing files. To locate the dirty data in dirty pages, FITDOC utilizes two mechanisms: by analyzing the distribution characteristics of dirty pages in the dirty bitmap, we propose a fast dirty bitmap scanning method to locate the dirty pages, and take a multi-threading data comparison mechanism to locate the real dirty data in one page. The experimental results show that compared with Xen's default system-level checkpointing algorithm, FITDOC can on average reduce checkpointing time 70.54 % with a 1 GB memory size and achieve better improvement for VMs with larger memory configurations. FITDOC can reduce the size of checkpointing data 52.88 % on average compared with Remus's incremental solution, which is in page granularity. Compared with the default dirty bitmap scanning method in Xen, the scanning time of FITDOC is decreased by 91.13 % on average. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Supercomputing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 117633340 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: FITDOC: fast virtual machines checkpointing with delta memory compression. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Du%2C+Yunjie%22">Du, Yunjie</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Shi%2C+Xuanhua%22">Shi, Xuanhua</searchLink><relatesTo>1</relatesTo><i> xhshi@hust.edu.cn</i><br /><searchLink fieldCode="AR" term="%22Jin%2C+Hai%22">Jin, Hai</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Wu%2C+Song%22">Wu, Song</searchLink><relatesTo>1</relatesTo><br /><searchLink fieldCode="AR" term="%22Yang%2C+Laurence%22">Yang, Laurence</searchLink> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Journal+of+Supercomputing%22">Journal of Supercomputing</searchLink>. Sep2016, Vol. 72 Issue 9, p3328-3347. 20p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Bit-mapped+graphics%22">Bit-mapped graphics</searchLink><br /><searchLink fieldCode="DE" term="%22Virtual+machine+systems%22">Virtual machine systems</searchLink><br /><searchLink fieldCode="DE" term="%22Digital+computer+simulation%22">Digital computer simulation</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+graphics%22">Computer graphics</searchLink><br /><searchLink fieldCode="DE" term="%22Data+logging%22">Data logging</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Virtualization provides the function of saving the entire status of the execution environment of a running virtual machine (VM), which makes checkpointing flexible and practical for HPC servers or data center servers. However, the system-level checkpointing needs to save a large number of data to the disk. Moreover, the overhead grows linearly with the increasing size of virtual machine memory, which leads to disk I/O consumption disaster along with poor system scalability. To target this, we propose a novel fast VM checkpointing approach, named Fast Incremental checkpoinTing with Delta memOry Compression (FITDOC). By studying the run-time memory characteristics of different workloads, FITDOC counts the dirty pages in a fine-granularity manner (i.e., the number of 8 bytes), instead of in the conventional method (i.e., the number of pages). FITDOC utilises a dirty page logging mechanism to record the dirty pages. Accordingly, a delta memory compression mechanism is implemented to eliminate redundant memory data in checkpointing files. To locate the dirty data in dirty pages, FITDOC utilizes two mechanisms: by analyzing the distribution characteristics of dirty pages in the dirty bitmap, we propose a fast dirty bitmap scanning method to locate the dirty pages, and take a multi-threading data comparison mechanism to locate the real dirty data in one page. The experimental results show that compared with Xen's default system-level checkpointing algorithm, FITDOC can on average reduce checkpointing time 70.54 % with a 1 GB memory size and achieve better improvement for VMs with larger memory configurations. FITDOC can reduce the size of checkpointing data 52.88 % on average compared with Remus's incremental solution, which is in page granularity. Compared with the default dirty bitmap scanning method in Xen, the scanning time of FITDOC is decreased by 91.13 % on average. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Journal of Supercomputing is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=117633340 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s11227-015-1429-5 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 20 StartPage: 3328 Subjects: – SubjectFull: Bit-mapped graphics Type: general – SubjectFull: Virtual machine systems Type: general – SubjectFull: Digital computer simulation Type: general – SubjectFull: Computer graphics Type: general – SubjectFull: Data logging Type: general Titles: – TitleFull: FITDOC: fast virtual machines checkpointing with delta memory compression. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Du, Yunjie – PersonEntity: Name: NameFull: Shi, Xuanhua – PersonEntity: Name: NameFull: Jin, Hai – PersonEntity: Name: NameFull: Wu, Song – PersonEntity: Name: NameFull: Yang, Laurence IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 09 Text: Sep2016 Type: published Y: 2016 Identifiers: – Type: issn-print Value: 09208542 Numbering: – Type: volume Value: 72 – Type: issue Value: 9 Titles: – TitleFull: Journal of Supercomputing Type: main |
| ResultId | 1 |
