5,117 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Performance Issues with Code Migration from Azure Synapse to Microsoft Fabric

Title: Performance Issues with Code Migration from Azure Synapse to Microsoft Fabric Details: I have been using Azure Synapse to curate code and create tables. After the introduction of Microsoft Fabric, I migrated all my code to Fabric. Currently, I am…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
Microsoft Fabric Training
Microsoft Fabric Training
Microsoft Fabric: A Microsoft unified data platform.Training: Instruction to develop new skills.
43 questions
asked 2025-01-11T13:45:07.5266667+00:00
Sarim Husain 0 Reputation points Microsoft Vendor
answered 2025-01-12T09:56:52.8133333+00:00
Vinodh247 26,936 Reputation points MVP
2 answers

how to fix this error The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'

getting error while synapse workspace deployment

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,521 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2024-12-09T14:46:47.8+00:00
Narendra Singh 15 Reputation points
commented 2025-01-11T03:44:00.18+00:00
milan barot 0 Reputation points
1 answer One of the answers was accepted by the question author.

Check if an Azure Synapse Cosmos DB linked service container is a Read-Only replica

I'm accessing a Cosmos DB through a linked service in Synapse. And we need to be able to verify if the replica we are accessing is readonly of if it has write capabilities; can we do this? I have tried several approaches but cant seem to find a way to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,721 questions
asked 2025-01-06T14:56:01.58+00:00
Mariano Peinador Perez 20 Reputation points Microsoft Employee
accepted 2025-01-10T21:30:44.8033333+00:00
Mariano Peinador Perez 20 Reputation points Microsoft Employee
0 answers

With Azure Synapse Analytics Copy Activity I use pagination to combine multiple REST calls into one JSON file.

With Azure Synapse Analytics Copy Activity I use pagination to combine multiple REST calls into one JSON file. The resulting data however is a combination of several JSON structures and itself not a valid JSON format. How can I combine the multiple REST…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-09T15:39:52.5166667+00:00
Jürg Gubler 0 Reputation points
commented 2025-01-10T20:07:47.3266667+00:00
Chandra Boorla 6,370 Reputation points Microsoft Vendor
1 answer

Notebook in Pyspark to compare schemas not naming the parquet file in correct format. It's defaulting instead of using name given

This code compares the schemas and then should update if needed. It updates to a new directory but does not keep the same name. I have tried everything how can I get it to rename to xyzYYYYMMDD.parquet for year in range(2024, 2025): # Adjust years as…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-07T17:34:36.94+00:00
Wurm, Yvonne L 0 Reputation points
commented 2025-01-10T16:35:29.3066667+00:00
Chandra Boorla 6,370 Reputation points Microsoft Vendor
1 answer

Granting the view permission for a stored procedure in a Synapse SQL pool

Hi, in a dedicated Synapse SQL pool is it to possible granting the view (and not the execution) permission for a stored procedure? Thanks

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2024-06-24T15:28:56.38+00:00
pmscorca 1,007 Reputation points
commented 2025-01-10T16:32:35.1066667+00:00
Akram, Mashood (Admin) 0 Reputation points
2 answers

Re-use dataflows active cluster

I have the following scenario. There are csv files that users can drop into the data lake at any time. I need to check each csv file in the data lake in real time. Part of the verification is done with dataflows in azure synapse analytics. The…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,100 questions
asked 2025-01-08T10:02:50.15+00:00
Junior Steve KAMDEM DJOKO 0 Reputation points
answered 2025-01-10T06:28:47.4766667+00:00
phemanth 12,895 Reputation points Microsoft Vendor
0 answers

Error while creating Synapse analytics workspace

The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-04T18:15:51.48+00:00
Naresh 5 Reputation points
commented 2025-01-10T06:06:58.4633333+00:00
phemanth 12,895 Reputation points Microsoft Vendor
1 answer

How to get database name from Synapse serverless SQL pool query history

I have used the DMVs to get the Synapse serverless SQL pool query history and Synapse Studio. I do see in the query text listing that shows the from statement with the name of the view <schema>.<view name> but I do not see the data source…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2024-12-16T12:30:26.8766667+00:00
Foster, Gwendolyn 0 Reputation points
commented 2025-01-10T05:20:06.2233333+00:00
phemanth 12,895 Reputation points Microsoft Vendor
0 answers

How to export a table from azure synapse dedicated DB pool

How to export a table from azure synapse dedicated DB pool

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-08T02:06:25.9+00:00
Naresh 0 Reputation points
commented 2025-01-10T04:35:04.77+00:00
Ganesh Gurram 3,025 Reputation points Microsoft Vendor
0 answers

Error while loading data

Getting below error message while loading data using Pipeline. Failure happened on 'Source' side. ErrorCode=DB2DriverRunFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Error thrown from driver. Sql code:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-07T17:24:25.6533333+00:00
Gunti, Srikanth 0 Reputation points
commented 2025-01-09T17:33:16.93+00:00
Smaran Thoomu 18,965 Reputation points Microsoft Vendor
1 answer

How to use the wheel packaged Json files in the Azure Synapse Spark job definition or Notebook

Hello Everyone I'm facing an issue on accessing the json file packaged as a Python wheel on the Synapse Spark Job definition file. Below are my configs. Any help would be truly appreciated. Thanks. I'm using the below setup.py file to package the pyspark…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-06T16:14:49.98+00:00
manigandan 0 Reputation points
commented 2025-01-09T17:23:08.1566667+00:00
Smaran Thoomu 18,965 Reputation points Microsoft Vendor
1 answer

why my Selfhosted, dedicated sql pool and builtin sql pool

why cant i access my SHIR, Sql Pools at the same time i was using all of them till yesterday and now all of the sudden everything is unavailable

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,100 questions
asked 2025-01-07T10:22:23.35+00:00
Raghuveeravenkata Pasala 0 Reputation points
commented 2025-01-09T17:03:50.21+00:00
Chandra Boorla 6,370 Reputation points Microsoft Vendor
2 answers

GIT enabled Synapse Workspace: is there any way to get the current branch name via Python?

Hi, I was wondering if there is any method (or some other way) to retrieve the name of the currently selected GIT branch programmatically within a running Synapse Notebook session using Python. To make thinks even more complicated: the Synapse…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2024-12-17T17:06:28.2566667+00:00
Martin B 121 Reputation points
commented 2025-01-09T07:27:31.26+00:00
Martin B 121 Reputation points
1 answer

Integration of On-Premises/third party Network with Synapse Spark

Hi Team, We have a requirement to integrate the on-premises network with Synapse Spark and extract data from the API hosted on the network. We have created an Azure Virtual Network Gateway and set up a site-to-site VPN connection between our local…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-08T12:18:15.8966667+00:00
Rupesh Galla 0 Reputation points
answered 2025-01-09T07:11:20.9366667+00:00
AnnuKumari-MSFT 33,986 Reputation points Microsoft Employee
1 answer

ServiceNow Linked Service not able to get the data using copy activity

I am trying to connect to Service now from synapse to copy data of incidents and some other data. I tested the linked service after providing the credential and as successful to test the connection. but when trying to preview the data, get the below…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-07T12:48:36.0633333+00:00
Dixan Thomas (Contractor) 0 Reputation points
commented 2025-01-09T05:58:40.8266667+00:00
Dixan Thomas (Contractor) 0 Reputation points
1 answer One of the answers was accepted by the question author.

How do I convert a dataverse table object to a json string using FetchXML

Hi there, In synapse pipeline, I want to convert a dataverse table object to a json string using FetchXML. Whether FetchXML can achieve this function? Any suggestion? Thanks&Regards, zmsoft

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-07T08:13:12.31+00:00
zmsoft 260 Reputation points
accepted 2025-01-09T02:35:25.4+00:00
zmsoft 260 Reputation points
3 answers

How to query Kusto data in Synapse with cert auth in linked service

Hi, I'm trying to query Kusto data with linked service in Synapse. Synapse can generate the samples automatically as below. It can work when I use secret of application in setting up linked service. But it failed with the error when I tried to use cert…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2024-04-10T06:26:26.6+00:00
Meng Zhang 31 Reputation points Microsoft Employee
answered 2025-01-08T20:51:27.91+00:00
Jeremy Peach 0 Reputation points Microsoft Employee
1 answer

request not authorized to read metadata from cosmos db analytical store.

i am getting error as error occured during snapshot metadata read phase -com.microsoft.azure.storage.storageexception: request not authorized to perform operation. details ")" when selecting the analytical store of cosmosdb. the data can be…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
asked 2025-01-06T14:44:18.5966667+00:00
ANKIT GHENGE 65 Reputation points
commented 2025-01-08T16:47:27.47+00:00
Chandra Boorla 6,370 Reputation points Microsoft Vendor
2 answers

How to get a predicate pushed to a workspace table?

In my Synapse workspace I have created a spark table linked to a Cosmos analytical store instance with the following details (as described here) create table if not exists mytable using cosmos.olap options (spark.synapse.linkedService…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,117 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,721 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,100 questions
asked 2025-01-05T12:31:52.1566667+00:00
Martin Smith 1 Reputation point
edited a comment 2025-01-08T11:06:03.5933333+00:00
Martin Smith 1 Reputation point