How to Download Data from huge volume source table in batches.
- Check mark "Target Delete Records"
- Enter 1=2 in "Target Delete Where Clause"
- Control your data relevancy logic in the where clause Package SQL statement.
Edit Package
- Collect > Target from Navigation Pane
- Click on Target Sources
- Click on Table Icon
- Select Table and click on vertical view of the table
- Advance Settings > Click on Package Name (it will open package in separate window by default)
- Click on vertical view of Package
- Click on Advance Properties and Click on Edit
- Check mark “Target Delete Records”
- Enter 1=2 in “Target Delete Where Clause”
- Save
Please note: If you need to recycle the data load from first load then you have to follow either one option to delete the existing data.
- remove the where clause from ADM/DSP which you add in Target Delete Where Clause or
- Manually delete data from table at Database level
There is another Option if you want to control logic throughout your data batch load;
- Add custom_column in Target Table of sdb database
- Insert Row_Number() during the data load
- Add custom_colum > 999999999 (or any row number) in “Target Delete Where Clause”
Comments
2 comments