We have a requirement to extract data from a source system in batches from a huge volume table. I am using a customized query in Package to extract data. The first batch of data is successfully loaded into the ‘sdb’ database table using relevancy criteria. Now I need to extract the second batch of data using relevancy criteria. As we know, when we extract data from the Source system and load it into ‘sdb’ database, the Assemble-Package first deletes all existing data from the ‘sdb’ table and then loads fresh data.
Has anyone loaded batch data into the ‘sdb’ database through ADM/DSP without deleting the existing data from the table? Although we can do it on the SQL Server level by making a copy of the existing table with data, I need ADM/DSP process to load data into ‘sdb’ table in batches using relevancy criteria without deleting existing data.