View in EDS PDF Full Text

DATA STREAMS MANAGEMENT IN THE REAL-TIME DATA WAREHOUSE: FUNCTIONING OF THE DATA STREAMS PROCESSOR.

Saved in:
Bibliographic Details
Title: DATA STREAMS MANAGEMENT IN THE REAL-TIME DATA WAREHOUSE: FUNCTIONING OF THE DATA STREAMS PROCESSOR.
Authors: Shoaib, M.1 shoaib•uet@hotmail.com, Majeed, F.1, Kalsoom, K.1, Majid, S.2, Mahmood, S.3
Source: Pakistan Journal of Science. Jun2011, Vol. 63 Issue 2, p42-49. 8p.
Subjects: Real-time computing software, Data extraction, Data structures, Information storage & retrieval systems
Abstract: Data stream applications are currently emerged as sources of Real Time Data Warehouse (RTDW) systems. Existing Extraction, Transformation and Loading (ETL) tools have not been crafted for fast, continuous and time-varying data streams. To address this, we have already proposed a framework of RTDW to efficiently capture process and load the data streams. This article provides technical architecture of Data Streams Processor, the main component of the framework. It discusses approximations in detail including data structures and processes to manage fast data streams in memory. Moreover, algorithm for approximations is presented and clarified with an example. Finally, Data Streams Processor is applied on a real-world case study. [ABSTRACT FROM AUTHOR]
Copyright of Pakistan Journal of Science is the property of Knowledge Bylanes and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:Data stream applications are currently emerged as sources of Real Time Data Warehouse (RTDW) systems. Existing Extraction, Transformation and Loading (ETL) tools have not been crafted for fast, continuous and time-varying data streams. To address this, we have already proposed a framework of RTDW to efficiently capture process and load the data streams. This article provides technical architecture of Data Streams Processor, the main component of the framework. It discusses approximations in detail including data structures and processes to manage fast data streams in memory. Moreover, algorithm for approximations is presented and clarified with an example. Finally, Data Streams Processor is applied on a real-world case study. [ABSTRACT FROM AUTHOR]
ISSN:00309877