Pushing data to ADLS Gen 2 using Web Activity
Jitender Kumar Chandel
21
Reputation points
I started working on getting GlobalOptionSet from Dynamics CRM. What I found is that dataflows cannot parse the JSON correctly.. so I thought to derive the values and label for each metadataid and push the same using web activity to ADLS gen 2. But I am getting an error message.
Below are the inputs and output of web activity pushing the data into ADLS
Activity input:
{
"method": "PUT",
"headers": {
"x-ms-blob-type": "BlockBlob",
"x-ms-date": "Wed, 08 Jan 2025 06:34:31 GMT",
"x-ms-version": "2018-03-28",
"Content-Type": "application/json"
},
"url": "https://dledwd.dfs.core.windows.net/datalake/data/landingzone/dynamics_crm/globaloptionset/a3ea7106-3423-4fac-896b-fa52e81b04a5.json",
"connectVia": {
"referenceName": "AutoResolveIntegrationRuntime",
"type": "IntegrationRuntimeReference"
},
"body": {
"Name": "msdyn_actiontype",
"MetadataId": "a3ea7106-3423-4fac-896b-fa52e81b04a5",
"Value": [
{
"value": "100000002",
"label": "EmailFollowup"
},
{
"value": "100000000",
"label": "KnowledgeArticleDraftReview"
},
{
"value": "100000003",
"label": "ReplyToCustomer"
},
{
"value": "100000001",
"label": "ResolveCase"
}
]
},
"authentication": {
"type": "MSI",
"resource": "https://storage.azure.com/"
}
}
**Error Message:**
{
Activity Error:
{
"error": {
"code": "MissingRequiredHeader",
"message": "An HTTP header that's mandatory for this request is not specified.\nRequestId:3785d1b6-301f-006d-4c97-61f3fb000000\nTime:2025-01-08T06:34:33.1121145Z"
},
"ADFWebActivityResponseHeaders": {
"x-ms-error-code": "MissingRequiredHeader",
"x-ms-request-id": "3785d1b6-301f-006d-4c97-61f3fb000000",
"x-ms-version": "2018-03-28",
"Date": "Wed, 08 Jan 2025 06:34:32 GMT",
"Server": "Windows-Azure-HDFS/1.0;Microsoft-HTTPAPI/2.0",
"Content-Length": "204",
"Content-Type": "application/json; charset=utf-8"
},
"effectiveIntegrationRuntime": "AutoResolveIntegrationRuntime (Central US)",
"executionDuration": 0,
"durationInQueue": {
"integrationRuntimeQueue": 0
},
"billingReference": {
"activityType": "ExternalActivity",
"billableDuration": [
{
"meterType": "AzureIR",
"duration": 0.016666666666666666,
"unit": "Hours"
}
]
}
}
Sign in to answer