Performance Issues with Code Migration from Azure Synapse to Microsoft Fabric
Title: Performance Issues with Code Migration from Azure Synapse to Microsoft Fabric Details: I have been using Azure Synapse to curate code and create tables. After the introduction of Microsoft Fabric, I migrated all my code to Fabric. Currently, I am…
how to fix this error The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'
getting error while synapse workspace deployment
Check if an Azure Synapse Cosmos DB linked service container is a Read-Only replica
I'm accessing a Cosmos DB through a linked service in Synapse. And we need to be able to verify if the replica we are accessing is readonly of if it has write capabilities; can we do this? I have tried several approaches but cant seem to find a way to…
With Azure Synapse Analytics Copy Activity I use pagination to combine multiple REST calls into one JSON file.
With Azure Synapse Analytics Copy Activity I use pagination to combine multiple REST calls into one JSON file. The resulting data however is a combination of several JSON structures and itself not a valid JSON format. How can I combine the multiple REST…
Notebook in Pyspark to compare schemas not naming the parquet file in correct format. It's defaulting instead of using name given
This code compares the schemas and then should update if needed. It updates to a new directory but does not keep the same name. I have tried everything how can I get it to rename to xyzYYYYMMDD.parquet for year in range(2024, 2025): # Adjust years as…
Granting the view permission for a stored procedure in a Synapse SQL pool
Hi, in a dedicated Synapse SQL pool is it to possible granting the view (and not the execution) permission for a stored procedure? Thanks
Re-use dataflows active cluster
I have the following scenario. There are csv files that users can drop into the data lake at any time. I need to check each csv file in the data lake in real time. Part of the verification is done with dataflows in azure synapse analytics. The…
Error while creating Synapse analytics workspace
The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'
How to get database name from Synapse serverless SQL pool query history
I have used the DMVs to get the Synapse serverless SQL pool query history and Synapse Studio. I do see in the query text listing that shows the from statement with the name of the view <schema>.<view name> but I do not see the data source…
How to export a table from azure synapse dedicated DB pool
How to export a table from azure synapse dedicated DB pool
Error while loading data
Getting below error message while loading data using Pipeline. Failure happened on 'Source' side. ErrorCode=DB2DriverRunFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Error thrown from driver. Sql code:…
How to use the wheel packaged Json files in the Azure Synapse Spark job definition or Notebook
Hello Everyone I'm facing an issue on accessing the json file packaged as a Python wheel on the Synapse Spark Job definition file. Below are my configs. Any help would be truly appreciated. Thanks. I'm using the below setup.py file to package the pyspark…
why my Selfhosted, dedicated sql pool and builtin sql pool
why cant i access my SHIR, Sql Pools at the same time i was using all of them till yesterday and now all of the sudden everything is unavailable
GIT enabled Synapse Workspace: is there any way to get the current branch name via Python?
Hi, I was wondering if there is any method (or some other way) to retrieve the name of the currently selected GIT branch programmatically within a running Synapse Notebook session using Python. To make thinks even more complicated: the Synapse…
Integration of On-Premises/third party Network with Synapse Spark
Hi Team, We have a requirement to integrate the on-premises network with Synapse Spark and extract data from the API hosted on the network. We have created an Azure Virtual Network Gateway and set up a site-to-site VPN connection between our local…
ServiceNow Linked Service not able to get the data using copy activity
I am trying to connect to Service now from synapse to copy data of incidents and some other data. I tested the linked service after providing the credential and as successful to test the connection. but when trying to preview the data, get the below…
How do I convert a dataverse table object to a json string using FetchXML
Hi there, In synapse pipeline, I want to convert a dataverse table object to a json string using FetchXML. Whether FetchXML can achieve this function? Any suggestion? Thanks&Regards, zmsoft
How to query Kusto data in Synapse with cert auth in linked service
Hi, I'm trying to query Kusto data with linked service in Synapse. Synapse can generate the samples automatically as below. It can work when I use secret of application in setting up linked service. But it failed with the error when I tried to use cert…
request not authorized to read metadata from cosmos db analytical store.
i am getting error as error occured during snapshot metadata read phase -com.microsoft.azure.storage.storageexception: request not authorized to perform operation. details ")" when selecting the analytical store of cosmosdb. the data can be…
How to get a predicate pushed to a workspace table?
In my Synapse workspace I have created a spark table linked to a Cosmos analytical store instance with the following details (as described here) create table if not exists mytable using cosmos.olap options (spark.synapse.linkedService…