Share via

Azure Data Factory with Dataverse Sink (mapping data flow) Upsert broken?

Noah Gilbert 26 Reputation points
2024-09-30T19:16:42.8+00:00

Simple ADF data flow with a dataverse sink (Dynamics 365).

Created an alternate key on a custom dataverse table and attempting to do an Upsert.

I have the Alter row transform with "Upsert if" -> true()

I have set the sink to Upsert (nothing else checked) and selected the key from Dataverse for the "Alternate key name" option.

When I attempt to run the Dataflow I get the error message: "Job failed due to reason: Insert method is not defined and you are executing insert operation. Please select insert method!"

I have not selected Insert explicitly on the sink, does this mean that Upsert is attempting to insert based on no matching record? If so, how do i 'select insert method'?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,727 questions
Dynamics 365 Training
Dynamics 365 Training
Dynamics 365: A Microsoft cloud-based business platform that provides customer relationship management and enterprise resource planning solutions.Training: Instruction to develop new skills.
134 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
34 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. phemanth 10,725 Reputation points Microsoft Vendor
    2024-10-01T05:58:47.2333333+00:00

    @Noah Gilbert

    Thanks for reaching out to Microsoft Q&A

    Based on your description, it's likely that the Upsert operation is indeed attempting to insert a record because no matching record is found in the Dataverse table. This is because you have set the "Upsert if" condition to true() in the Alter row transform, which means that if no matching record is found, a new record will be inserted.

    To resolve this issue, you need to define the insert method for the Dataverse sink. Here are the steps to follow:

    1. Go to the Sink settings: In your ADF data flow, navigate to the Sink settings for the Dataverse sink.
    2. Select the Insert method: In the Sink settings, select the "Insert method" option and choose the appropriate method for inserting records into your Dataverse table.
    3. Save and re-run the data flow: Save your changes and re-run the data flow to test the Upsert operation.

    If you continue to face issues, it might be helpful to check the following:

    • Alternate Key Configuration: Ensure that the alternate key you have configured in Dataverse is correctly set up and matches the key used in your Data Flow.
    • Data Flow Debugging: Enable Data Flow debug mode to get more detailed error messages and insights into what might be going wrong.

    For more detailed guidance, you can refer to the official documentation on Sink transformation in mapping data flow1 and Alter row transformation.

    0 comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.