Hello @Ozi ,
Thanks for the ask and using Microsoft Q&A platform .
As we understand the ask here is to copy the data for cdc enabled table from source to sink and also you want to this without foreach and lookup table . Please do let me know if that is not accurate,
Just to make sure you understand the reason as to why the we are using the lookup and foreach here .
Why we are using the Lookup ?
As you mentioned that you have 100 table which are cdc enabled and needs to be copied . The lookup here helps get all the details of the 100 tables .
By implmenting this , we are making the solution more generic . In future if you add enable cdc on 10 more table , this should take care of that .
Why are you using the foreach loop ?
We are looping through all the 100 table and copying them in parallel .
I understand that you are new to ADF , but then Lookup and foreach are very much used in the pipelines and i suggest that give it some time to learn .
https://zcusa.951200.xyz/en-us/azure/data-factory/control-flow-lookup-activity
https://zcusa.951200.xyz/en-us/azure/data-factory/control-flow-for-each-activity
Can you make the implement this without Lookup and FE loop ?
I think we can do that with a simple copy activity , but then the solution will not be generic . In the source you will have to specify the table name
select * from cdc.HR_Employee_ct
In other words what this means is that you will have to create one copy actvity for each table .
Updated :3/4/2022
I am adding the below animation of my implemenatation . Please do click on the image of the ADF and the snaimation should work .
https://imgur.com/a/9ERFtqI
Please dont forgot to define temparray .
Please do let me if you have any queries .
Thanks
Himanshu
-------------------------------------------------------------------------------------------------------------------------
- Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
- Want a reminder to come back and check responses? Here is how to subscribe to a notification
- If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators