Institutional Repository
| etl workflow analysis and verification using backwards constraint propagation | |
| Liu Jie; Liang Senlin; Ye Dan; Wei Jun; Huang Tao | |
| 2009 | |
| Conference Name | 21st International Conference on Advanced Information Systems Engineering, CAiSE 2009 |
| Source | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
| Pages | 455-469 |
| Conference Date | 43990 |
| Conference Place | Amsterdam, Netherlands |
| Indexed Type | 其他 |
| Publish Place | Germany |
| Publisher | Germany |
| ISSN | 3029743 |
| ISBN | 3642021433 |
| Department | (1) University of Science and Technology of China, Anhui Hefei, China; (2) Institute of Software, Chinese Academy of Sciences, Beijing, China; (3) Department of Computer Science, State University of New York at Stony Brook, Stony Brook NY 11794, United States |
| English Abstract | One major contribution of data warehouses is to support better decision making by facilitating data analysis, and therefore data quality is of primary importance. ETL is the process that extracts, transforms, and ultimately loads data into target warehouses. Although ETL workflows can be designed by ETL tools, data exceptions are largely left to human analysis and handled inadequately. Early detection of exceptions helps to improve the stability and efficiency of ETL workflows. To achieve this goal, a novel approach, Backwards Constraint Propagation (BCP), is proposed that automatically analyzes ETL workflows and verifies the target-end restrictions at their earliest points. BCP builds an ETL graph out of a given ETL workflow, encodes the target-end restrictions as integrity constraints, and propagates them backwards from target to sources through the ETL graph by applying constraint projection rules. It is showed that BCP supports most relational algebra operators and data transformation functions. © 2009 Springer Berlin Heidelberg. |
| Keyword | Information Systems |
| Sponsorship | University of Twente; Centre for Telematics and Information Technology; Netherlands Organisation for Scientific Research; Jacquard; Capgemini |
| Language | 英语 |
| Content Type | 会议论文 |
| URI | http://ir.iscas.ac.cn/handle/311060/8498 |
| Collection | 软件工程技术研究开发中心 |
| Recommended Citation GB/T 7714 | Liu Jie,Liang Senlin,Ye Dan,et al. etl workflow analysis and verification using backwards constraint propagation[C]. Germany:Germany,2009:455-469. |
| Files in This Item: | ||||||
| File Name/Size | DocType | Version | Access | License | ||
| etl workflow analysi（444KB） | 开放获取 | -- | Application Full Text | |||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment