Data Integration

SAP Data Services

SAP Data Services delivers a single enterprise-class solution for Data Integration, Data Quality, Data Profiling, and Text Data Processing that allows us to integrate, transform, improve, and deliver trusted data to critical business processes.

Pages

One Stop to SAP BODI/BODS

BODI Business Objects Data Integrator or BODS Business Objects Data Services is a GUI workspace that allows to create jobs that extracts data from heterogeneous sources, transforms that data using built-in transforms and functions to meet business requirements and then loads the data into a single datastore or data warehouse for further analysis.

Updated on May 14, 2019

How to install SAP BODS - Standalone

This article is a step by step guide on how to install standalone SAP BODS Batch Job Server, Client Components, Web based Administrative Console and how to configure the same.

Updated on May 14, 2019

SAP BODS Cluster Installation

This article is a step by step guide on how to configure SAP BODS for High Availability using Windows Cluster services. To take advantage of fail-over support for SAP BusinessObjects Data Services services in a Windows Clustering Environment, Windows cluster must be created before installing the software.

Updated on May 14, 2019

Why SAP Data Services

SAP BusinessObjects Data Services delivers a single enterprise-class solution for Data Integration, Data Quality, Data Profiling, and Text Data Processing that allows us to integrate, transform, improve, and deliver trusted data to critical business processes. Read on to know more.

Updated on May 14, 2019

Getting Started SAP BODS

This article is a step by step guide to learn the basic of SAP BODS. Starting from the Basic we will cover the essential topics like SCD implementation, Fact loading, CDC Mechanisms, Persistent Cache, Substitution Parameters, Variables and Parameters, Data Quality and many more.

Updated on May 14, 2019

Fools Guide to BODS - Introductory Tutorial

This article is a guide to the readers who are totally ignorant about the tool SAP Business Objects Data Services. It is presented in a very simple way so that readers would be familiar with common terms, terminologies and would be able to run simple programs.

Updated on May 14, 2019

Fools Guide to BODS - Repository Creation

In the first chapter of this article we have learnt the very basic of BODS. In this part of the article we will begin with BODS Repository creation process

Updated on May 14, 2019

Fools Guide to BODS - Registering Repository to CMC

In our earlier article, we have learnt how to create a repository in BODS. Once that part is done, The final process before launching the BODS application is registering the repository with CMC.

Updated on May 14, 2019

Fools Guide to BODS - Designer

In our earlier article on Data Services we have learnt how to register the local repository with CMC. In this part of the article we will start using Data Services Designer.

Updated on May 14, 2019

SAP BODS Transforms

This article deals with the various types of transformations available in SAP BODS. Transformations are in-built, optional objects used in dataflow to transform source data to desired output dataset objects available in Local Object Library under the Transforms tab. There are four categories of Transform available in SAP BODS namely Data Integrator, Data Quality, Platform and Text Data Processing.

Updated on May 14, 2019

Working with Data Services Flatfiles

In this article we will try to cover all the possible scenarios related to flatfiles in SAP Data Services.

Updated on May 14, 2019

How to handle multiple input file in SAP Data Services

In this tutorial, we will learn how we can use a single data flow to process multiple input files of same structure using SAP Data Services. Like before, we have included one hands-on video with the tutorial to help you see the technique in action

Updated on May 14, 2019

Data Services Flatfiles Tips

Often we come across scenarios where we have the flat file definition in an excel sheet and we need to create corresponding File Format in SAP Data Services. Alternatively we import file format definition from a Sample Source file.

Updated on May 14, 2019

XML file generation using SAP Data Services

This article will demonstrate how to generate XML target files using SAP Data Services. Here our objective is to generate XML file with employee and department information.

Updated on May 14, 2019

Handling XML source files in SAP Data Services

This article will demonstrate how to read data from XML based source files using SAP Data Services. Here our objective is to load employee and department information respectively from the source XML based file.

Updated on May 14, 2019

Exception Handling While Reading Multiple XML Files in Data Services

This article will demonstrate loading multiple XML files using SAP Data Services including Exception Handling.

Updated on May 14, 2019

Learning SAP Data Services - Online Tutorial

We are pleased to start this new tutorial page for SAP BusinessObjects Data Services (BODS). If you do not know SAP Data Services (BODS) yet but wish to master this ETL tool, you have come to the right place. Even if you are already familiar with this tool, we hope you can still learn a lot of things from our articles as we progress further. Also please note, all the articles in this series will be backed by corresponding video tutorials and we highly recommend you to watch the videos as and when you read the articles. Let's get started.

Updated on May 14, 2019

How to use Lookup and Join in SAP Data Services

In this tutorial, we will learn how to perform lookup and join in SAP BusinessObjects data services using the Query Transform. In the way, we will also see how to use some of the basic inbuilt functions that are provided in data services. A short video is provided with this tutorial to give you a hands-on feel in data services.

Updated on May 14, 2019

How to use SAP Data Services Case Transform

In this tutorial, we will learn how to use SAP data services Case Transform. Case transform provide us a means to implement "If... Then... Else" logic in data services. In the end a short video is provided with this tutorial to give you a hands-on feel in data services.

Updated on May 14, 2019

Using MERGE Transform in SAP Data Services

This tutorial describes how to use MERGE transform in SAP Data Services (formerly known as BusinessObjects Data Services). A short video is also provided to provide hands-on.

Updated on May 14, 2019

Data Services Scenario Questions Part 1

In this tutorial we will discuss some scenario based questions and their solutions using SAP Data Services. This article is meant mainly for Data Services beginners.

Updated on May 14, 2019

Data Services Scenario Questions Part 2

In this tutorial we will discuss some scenario based questions and their solutions using SAP Data Services. This article is meant mainly for Data Services beginners.

Updated on May 14, 2019

Data Services Scenario Questions Part 3

In this tutorial we will discuss some scenario based questions and their solutions using SAP Data Services. This article is meant mainly for Data Services beginners.

Updated on May 14, 2019

Data Services Scenario Questions Part 4

In this tutorial we will discuss some scenario based questions and their solutions using SAP Data Services. This article is meant mainly for Data Services beginners.

Updated on May 14, 2019

Data Services Scenario Questions Part 5

In this tutorial we will discuss some scenario based questions and their solutions using SAP Data Services. This article is meant mainly for Data Services beginners.

Updated on May 14, 2019

Data Services Scenario Questions Part 6

In this tutorial we will discuss some scenario based questions and their solutions using SAP Data Services. This article is meant mainly for Data Services beginners.

Updated on May 14, 2019

Data Services Scenario Questions Part 7

In this tutorial we will discuss some scenario based questions and their solutions using SAP Data Services. This article is meant mainly for Data Services beginners.

Updated on May 14, 2019

How to use Data Services Pivot Transformation

In this article, we will learn how to use SAP Data Services Pivot Transform. The Pivot transformation allows us to change how the relationship between rows is displayed. For each value in each pivot column, Data Services produces a row in the output data set. We can create pivot sets to specify more than one pivot columns. It basically convert Columns to Rows.

Updated on May 14, 2019

How to use Data Services Reverse Pivot Transformation

In this article, we will learn how to use SAP Data Services Reverse Pivot Transform. The Reverse Pivot transformation combines data from several rows into one row by creating new columns. For each unique value in a pivot axis column and each selected pivot column, Data Services produces a column in the output data set. It basically creates one row of data from several existing rows, i.e. to Pivot Rows to Columns.

Updated on May 14, 2019

Table Comparison Transform to Implement Slowly Change Dimension (SCD) in Data Service

In this tutorial we will learn a new SAP Data services transform, known as Table Comparison Transform and we will see how we may use this transform to implement "slowly changing dimension" (SCD) Type - I. Like before, we have added a video tutorial at the end to perform a little hands-on.

Updated on May 14, 2019

How to implement SCD Type 2 using History Preserve Transform in Data Services

This tutorial teaches you how to use the "History Preserving Transform" in SAP Data Services (BODS) by demonstrating a practical use of this transform for the implementation of SCD Type 2. We have also provided hands-on video below so that you can see how to do it yourself.

Updated on May 14, 2019

How to implement SCD Type 3 in Data Services

In this tutorial we will learn how to implement Slowly Changing Dimension of Type 3 using SAP Data Services. SCD type 3 design is used to store partial history. Here we are only interested to maintain the "current value" and "previous value" of an attribute. That is, even though the value of that attribute may change numerous times, at any time we are only concerned about its current and previous values.

Updated on May 14, 2019

SAP Data Services Analytic Functions

In this tutorial we will learn how to implement Cumulative Sum in SAP Data Services (BODS). Since there is no available in-built Analytic Functions in SAP Data Services, we will achieve the end result by exploiting some in-built Data Services features. Also this tutorial will show us how to manipulate Data Flow Parameter values at Data Flow level itself by using the trick of Custom Function calls.

Updated on May 14, 2019

RANK in Data Services

In this article, we will learn how to implement RANK operation in SAP Data Services.

Updated on May 14, 2019

DENSE RANK in Data Services

In this article, we will learn how to implement DENSE RANK operation in SAP Data Services.

Updated on May 14, 2019

GROUP RANK in Data Services

In this article, we will learn how to implement RANK and DENSE RANK operations on GROUP in SAP Data Services.

Updated on May 14, 2019

Data Services Scripting Language

We can use the Data Services Scripting Language to write scripts and custom functions to address complex logical expressions.

Updated on May 14, 2019

SAP Data Services Custom Function

We can create our own functions by writing script functions in SAP Data Services scripting language using the smart editor. User-script functions return a value.

Updated on May 14, 2019

Auditing in SAP Data Services

A proper data reconciliation process must be in place in any data Extraction-Transformation-Load (ETL) process. A successful reconciliation process should only indicate whether or not the data is correct. But data reconciliation is not easy. Fortunately for us, Data Services (BODS) provides an in-built data reconciliation feature called Auditing. Auditing is a way to ensure that a dataflow loads correct data into the target warehouse. Let's see how...

Updated on May 14, 2019

Error Handling, Recoverability- SAP Data Services

Error Handling, Recoverability are the important aspects of any ETL tool. Some of the ETL tools have some sort of in-built error-handling and automatic recovery mechanisms in place.

Updated on May 14, 2019

Real Time Jobs in Data Services

SAP Data Services provides Realtime Data Integration features. Data Services can generate realtime event messages and can also listen to input XML messages. Real Time Job means, some message with content will trigger the Job or Dataflow processing. A RealTime Job is started once and keeps running basically for ever. So Data Services acts like a server process.

Updated on May 14, 2019

Web Service Call in SAP Data Services

This article demonstrates, how to implement external web services call in SAP Data Services.

Updated on May 14, 2019

Text Data Processing using SAP Data Services

This article deals with Text Data Processing using SAP Business Objects Data Services with the intention of Text Analytics. SAP BODS provides a single ETL platform for both Structured and Unstructured data as well as Data Quality, Data Profiling and Data Cleansing functionalities.Entity Extraction transform available as a part of Text Data Processing of Data Services, helps to extract entities, entity relationships and facts from unstructured data for downstream analytics. The transform performs linguistic processing on content by using semantic and syntactic knowledge of words, to identify paragraphs, sentences, clauses, entities and facts from textual information.

Updated on May 14, 2019

Map_CDC_Operation in Data Services

Map CDC Operation is used to support relational or mainframe changed-data capture (CDC). This transform reads the source DML changes i.e. INSERT/UPDATE/DELETE and reflects the same in the target system. So the transform maps all the source rows logged as insert to an insert, all updates to update and the deletes to delete in the target table.

Updated on May 14, 2019

SCD implementation from Source based CDC table

Consider a scenario where we want to capture all or any changes in the source table to be maintained as history in our data warehouse dimension table. So if we consider day end batch load we will miss out any intermediate changes to the master data as the OLTP system doesn't maintains version. But what if we have already captured the changes via database CDC mechanism. Then based on the operation type and operation order of CDC based source table we can ascertain the corresponding operations to the dimension table. We can even avoid lookup to the target dimension table for SCD Type 2 implementation with optimum performance.

Updated on May 14, 2019

Data Services Metadata Query Part 1

Data Services provides full access to the repository metadata tables and views for metadata analysis. To access this metadata either we can use SQL SELECT statements or use the metadata reporting from Management Console.

Updated on May 14, 2019

Data Services Metadata Query Part 2

This article is a continuation of the previous topic related to Data Services Metadata Query. Let us explore more into the Data Services Repository Metadata.

Updated on May 14, 2019

Data Services Metadata Query Part 3

This article is a continuation of the previous topic related to Data Services Metadata Query. Let us explore more into the Data Services Repository Metadata.

Updated on May 14, 2019

Top 50 SAP Business Objects Data Services (BODS) Interview Questions with Answers

Learn the answers of some critical questions commonly asked during SAP BO Data Services interview.

Updated on May 14, 2019
© DWBI