Learning Path for ETL Concepts

New to this topic? Not sure where to start? For your convenience, we have created the below learning path where articles are organised in the order of their relevance and complexity. Start from the beginning and read one by one to master the subject.

OrderTopicLevelCBIP
1What is Data Integration (DI)?Basic 
2Why do we need Staging Area during ETL LoadBasic
3Methods of Incremental Loading in Data WarehouseBasic 
4Incremental Loading for Dimension TableIntermediate 
5Incremental Loading for Fact TablesIntermediate 
6Building the Next Generation ETL data loading FrameworkBasic

Do you wish for an ETL framework that is highly customizable, light-weight and suits perfectly with all of your data loading needs? We too! Let's build one together...

In the previous articles, we have discussed the general concepts of incremental data loading as well as how to perform incremental data loading for dimension tables. In this article we will discuss the methods and issues of loading data incrementally in Fact tables of a data warehouse.

In our previous article we have discussed the concept of incremental loading in general. In this article we will see how to perform incremental loading for dimension tables.

Incremental loading a.k.a Delta loading is an widely used method to load data in data warehouses from the respective source systems. This technique is employed to perform faster load in less time utilizing less system resources. In this tutorial we will understand the basic methods of incremental loading.

"We have a simple data warehouse that takes data from a few RDBMS source systems and load the data in dimension and fact tables of the warehouse. I wonder why we have a staging layer in between. Why can’t we process everything on the fly and push them in the data warehouse?"

In this tutorial we will learn - what is meant by the term "Data Integration" (DI), how data integration is done and why the need of data integration often requires us to build a data warehouse.


Have a question on this subject?

Feel free to ask your question to our expert community members and get clarified on your doubts in a minute. Asking a question or engaging in a meaningful technical discussion is both easy and rewarding. Let's do it now.

Are you on Twitter?

Start following us. This way we will always keep you updated with what's happening in Data Analytics community