Pushing data to ADLS Gen 2 using Web Activity

Jitender Kumar Chandel 21 Reputation points
2025-01-08T06:37:14.9566667+00:00

I started working on getting GlobalOptionSet from Dynamics CRM. What I found is that dataflows cannot parse the JSON correctly.. so I thought to derive the values and label for each metadataid and push the same using web activity to ADLS gen 2. But I am getting an error message.
Below are the inputs and output of web activity pushing the data into ADLS

Activity input:

{

"method": "PUT",

"headers": {

    "x-ms-blob-type": "BlockBlob",

    "x-ms-date": "Wed, 08 Jan 2025 06:34:31 GMT",

    "x-ms-version": "2018-03-28",

    "Content-Type": "application/json"

},

"url": "https://dledwd.dfs.core.windows.net/datalake/data/landingzone/dynamics_crm/globaloptionset/a3ea7106-3423-4fac-896b-fa52e81b04a5.json",

"connectVia": {

    "referenceName": "AutoResolveIntegrationRuntime",

    "type": "IntegrationRuntimeReference"

},

"body": {

    "Name": "msdyn_actiontype",

    "MetadataId": "a3ea7106-3423-4fac-896b-fa52e81b04a5",

    "Value": [

        {

            "value": "100000002",

            "label": "EmailFollowup"

        },

        {

            "value": "100000000",

            "label": "KnowledgeArticleDraftReview"

        },

        {

            "value": "100000003",

            "label": "ReplyToCustomer"

        },

        {

            "value": "100000001",

            "label": "ResolveCase"

        }

    ]

},

"authentication": {

    "type": "MSI",

    "resource": "https://storage.azure.com/"

}
}  
  
  
**Error Message:**

{

Activity Error:

{

"error": {

	"code": "MissingRequiredHeader",

	"message": "An HTTP header that's mandatory for this request is not specified.\nRequestId:3785d1b6-301f-006d-4c97-61f3fb000000\nTime:2025-01-08T06:34:33.1121145Z"

},

"ADFWebActivityResponseHeaders": {

	"x-ms-error-code": "MissingRequiredHeader",

	"x-ms-request-id": "3785d1b6-301f-006d-4c97-61f3fb000000",

	"x-ms-version": "2018-03-28",

	"Date": "Wed, 08 Jan 2025 06:34:32 GMT",

	"Server": "Windows-Azure-HDFS/1.0;Microsoft-HTTPAPI/2.0",

	"Content-Length": "204",

	"Content-Type": "application/json; charset=utf-8"

},

"effectiveIntegrationRuntime": "AutoResolveIntegrationRuntime (Central US)",

"executionDuration": 0,

"durationInQueue": {

	"integrationRuntimeQueue": 0

},

"billingReference": {

	"activityType": "ExternalActivity",

	"billableDuration": [

		{

			"meterType": "AzureIR",

			"duration": 0.016666666666666666,

			"unit": "Hours"

		}

	]

}

}

User's image

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,100 questions
Dynamics 365 Training
Dynamics 365 Training
Dynamics 365: A Microsoft cloud-based business platform that provides customer relationship management and enterprise resource planning solutions.Training: Instruction to develop new skills.
162 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
28 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.