Configure Incremental Data Mart Load

This page will provide an overview of things to consider when creating Access Views for Information Sources supporting incremental load as the Data Mart source.

In most cases the Access Views to be used by Analysis Models are based on On Line access. It is however recommended to use Data Mart (DM) access views as the base for creating Access Views for cases where the Data Mart access is based on Incremental Load. The reason being that for Incremental Load the DM table can be updated on a rather frequent basis, based on source table changes and only adding or updating as few rows as possible. The DM table can then be kept up-to-date by e.g. refreshing every hour.

This page only supplies some general advice. For more information, please refer to Data Mart administration and configuration.

Contents

Enable Data Access Type

When Data Mart access is chosen for an Information Source, it is advised to make sure that the Enabled Data Access Type is defined correctly.

This is done in the Information Sources feature.

If Enabled Data Access Type is set to All it means that the entity (e.g. Fact) supports both On Line and Data Mart access.

Activating an Entity

Before starting a transfer to the Data Warehouse in SQL Server it is necessary to create the first snapshot in the Data Mart source table. This is called to Activate an entity.

Make sure that the Refresh Mode is set to Full before activating. This means that a full refresh will be performed.

Note: It is possible to perform the refresh using filter conditions to reduce the number of transactions. Normally these types of conditions are handled on the SQL Server side.

When the first refresh has successfully finished, modify the Refresh Mode by setting it to Incremental. The entity is now prepared for incremental update,

Creating a Refresh Category

The next step would be to make sure that entities supporting incremental loaded are refreshed on a regular basis.

To do this, start by create a Data Mart Refresh Category and then add the entities to be refresh with the same schema to the created category.

 

Setting up a Refresh Schedule

When the entities to be refreshed have been added to a Data Mart Refresh Category, this category can be used as input when setting up a refresh schema.

Use the feature Data Mart Refresh Categories and click on Schedule to navigate to the New Database Task Schedule window in IEE client. Configure the schedule and start it.

Assume that a schedule is set up to execute every hour, of course means that the entities in the used Data Mart Refresh Category will be refreshed every hour. The refresh is done according to the Refresh Mode in the Entity Info - Incremental Load form.