Share via

SSIS Incremental Extract and Load for Multiple Tables in one Job / Pipeline

Dinesh Kumar Sharma 20 Reputation points
2024-12-12T12:02:51.8133333+00:00

Greetings,

We have one Source System DB (SQL) which had 120 Tables. I want to Extract all Tables (120) from Source Database and then Load them in Target Database (which is also SQL).

Key Requirements:

  1. I want to run this as Job, one time daily
  2. Incremental data updates can happen from all source tables to target tables after initial full data load
  3. No transformation Required

Please assist.

Thanks and Regards

Dinesh Sharma

SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,619 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. ZoeHui-MSFT 38,956 Reputation points
    2024-12-13T05:22:18.33+00:00

    Hi @dinesh kumar sharma

    Do you have a column for datetimestamp? If yes you may update the tables with the datetimestamp via Execute SQL Task.

    Here is also a same thread you may take a reference to..

    https://stackoverflow.com/questions/37197332/best-incremental-load-method-using-ssis-with-over-20-million-records

    Regards，

    Zoe Hui

    If the answer is helpful, please click "Accept Answer" and upvote it.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.