Load Types¶
Below two types of Loading are applicable for Parquet Data Sources.
- Full Load
- Incremental Load
Full Load¶
This is the default Load Type for all Parquet Data Sources.
When reading data from the defined Oracle view to the Parquet file, all available data will be transferred each time the Parquet Data Source is refreshed based on the defined Max Age. During the loading, any existing parquet file will be overwritten with a new file.
For Dimensions, this is the typical data loading method. For facts, this can be used as a load method.
Incremental Load¶
The Incremental load can be used for the Data Sources where Load Type = Incremental. During the incremental load, new partitions will be created, and changed partitions will be overwritten.