5,092 questions with Azure Synapse Analytics tags

Sort by: Updated
1 answer

Deployment Failed in Azure Synapse: SKU 'name' missing error

"I'm trying to deploy an Azure Synapse Workspace and keep encountering the following error: 'The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'.' The full error is: { "code":…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-24T13:05:27.6333333+00:00
azizure 0 Reputation points
commented 2024-12-27T00:51:10.84+00:00
Ganesh Gurram 2,305 Reputation points Microsoft Vendor
0 answers

How to limit synapse spark to only send WARN/ERROR logs to log analytics workspace ?

I have followed the steps here: https://zcusa.951200.xyz/en-us/azure/synapse-analytics/spark/apache-spark-azure-log-analytics But now all the internal driver/executor logs are getting sent to log analytics workspace, which is leading to storage…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-18T16:08:15.2766667+00:00
_user_unknown_ 1 Reputation point
commented 2024-12-26T17:54:27.9166667+00:00
_user_unknown_ 1 Reputation point
1 answer

GIT enabled Synapse Workspace: is there any way to get the current branch name via Python?

Hi, I was wondering if there is any method (or some other way) to retrieve the name of the currently selected GIT branch programmatically within a running Synapse Notebook session using Python. To make thinks even more complicated: the Synapse…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-17T17:06:28.2566667+00:00
Martin B 121 Reputation points
commented 2024-12-26T16:48:17.17+00:00
phemanth 12,580 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

How to Execute DROP VIEW Command in Synapse Notebook with SQL Serverless Pool Connection?

How to Connect Synapse Notebook to SQL Serverless Pool for Executing DROP VIEW Command? I’m working with Azure Synapse Analytics and need to connect my Synapse Notebook to a SQL Serverless Pool to directly drop and create views. However, when I try…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-23T13:16:04.3133333+00:00
MulluriNivas-6816 100 Reputation points
accepted 2024-12-26T14:15:43.5666667+00:00
MulluriNivas-6816 100 Reputation points
1 answer

How to fix 500 error on postman API

Hello Team, I am trying to create external APIs for my serverless SQL pool on postman. So I have created required access tokens using this URL (`https://login.microsoftonline.com/

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-19T18:39:14.1+00:00
Shrimathi M 40 Reputation points
edited a comment 2024-12-26T12:49:38.5333333+00:00
Chandra Boorla 5,755 Reputation points Microsoft Vendor
2 answers

Getting TokenNotFoundInConfigurationException error when uploading a Python wheel as workspace package in Synpase

Hello Everyone I'm using Azure Synapse to run my Spark pipelines. I've build my pipeline to use a custom library code from utils package of the same project to perform some operation. To access the utils.pipeline file, have packaged my entire project in…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,511 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
Azure Data Lake Analytics
asked 2024-12-25T05:25:33.01+00:00
manigandan 0 Reputation points
commented 2024-12-26T02:42:29.3366667+00:00
Smaran Thoomu 18,710 Reputation points Microsoft Vendor
1 answer

Issue with Corrupted Azure Synapse Workspace During Creation

An issue has arisen with an Azure Synapse Analytics workspace during its creation process. Due to an error or misconfiguration during setup, the workspace became corrupted. As a result, the workspace is in a non-functional state and cannot be deleted or…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-23T12:56:24.19+00:00
Bram Teunis 0 Reputation points
commented 2024-12-26T02:33:56.85+00:00
Smaran Thoomu 18,710 Reputation points Microsoft Vendor
1 answer

Unable to create synapse workspace - property 'name' not found in 'sku'

I'm trying to create a new synapse workspace and receive the following error. { "code": "DeploymentFailed", "message": "At least one resource deployment operation failed. Please list deployment operations for…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-24T05:57:21.6+00:00
robjkc 0 Reputation points
commented 2024-12-26T02:33:09.4033333+00:00
Smaran Thoomu 18,710 Reputation points Microsoft Vendor
1 answer

unable to edit dataflow in synapse after creating it.

I have created dataflows in Pipeline but they are not editable. I am clicking on it to edit but it's not opening for me to edit

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-22T14:55:07.7+00:00
Swarnima 0 Reputation points
commented 2024-12-25T13:53:49.23+00:00
Chandra Boorla 5,755 Reputation points Microsoft Vendor
1 answer

Read data from Databricks Delta Sharing to Azure Synapse

Hi, I am trying to read the data from Databricks Delta Sharing and write the data to Azure Synapse by referring this documentation https://docs.databricks.com/en/connect/external-systems/synapse-analytics.html#language-python I have constructed below…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,285 questions
asked 2024-12-18T15:05:16.13+00:00
Cheng, Jack 0 Reputation points
edited a comment 2024-12-24T16:13:46.5666667+00:00
Ganesh Gurram 2,305 Reputation points Microsoft Vendor
0 answers

issues in synapse pipelines which accessing the checkpoints key with input parameters

hello team, i am getting synapse analytics pipelines failures with error referring the checkpoint mistaching with the checkpoint in input parameters. tried to check the input as the respective dataflow is fetching data from cosmosDb with CDC approach…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,511 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-20T14:24:05.0233333+00:00
ANKIT GHENGE 40 Reputation points
commented 2024-12-24T12:20:26.9966667+00:00
Ganesh Gurram 2,305 Reputation points Microsoft Vendor
0 answers

Select transformation output schema is empty after renaming columns

I've followed the example from the link: https://zcusa.951200.xyz/en-us/azure/data-factory/tutorial-data-flow-dynamic-columns It's exactly what I need for my project, but unfortunately, no matter what I do, the output schema of the select…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,051 questions
asked 2024-11-20T16:26:53.2266667+00:00
AdnanT 0 Reputation points
commented 2024-12-24T06:40:50.8266667+00:00
AnnuKumari-MSFT 33,976 Reputation points Microsoft Employee
1 answer

Session failed. Run the notebook to start a new session.

I've recently created a spark pool in Azure Synapse Analytics. However, when i try to run a notebook, i got this error: Spark_Ambiguous_SparkSubmit_SparkSubmitProcessFailedExitCode1: Livy session has failed. Session state: Dead. Error code:…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-19T19:11:33.6933333+00:00
Roberto Ebratt 5 Reputation points
commented 2024-12-23T01:08:27.29+00:00
Chandra Boorla 5,755 Reputation points Microsoft Vendor
1 answer

How to restore a synapse SQL pool datawarehouse database

Hi All. Working on recovering a deleted synapse analytics workspace which also has a SQL pool, is there a way to recover if its deleted ? At the time, the deletion encountered an error and therefore was not fully deleted. but i was unable to recovery the…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-18T18:57:26.6266667+00:00
MrFlinstone 641 Reputation points
commented 2024-12-23T01:02:03.3266667+00:00
Chandra Boorla 5,755 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Add Synapse Administrator role assgiment for manged identitiy - 403 authorization error

Hey, I am implementing logic that assigns roles in Azure Synapse Workspace. I have the following setup: Marketplace app that deploys resources to customer subscriptions (it has denied assignments) creates Azure Synapse Workspace creates managed…

Azure Managed Applications
Azure Managed Applications
An Azure service that enables managed service providers, independent software vendors, and enterprise IT teams to deliver turnkey solutions through the Azure Marketplace or service catalog.
155 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-12-17T21:02:34.68+00:00
Adrian Flejszer 20 Reputation points
accepted 2024-12-22T20:11:00.56+00:00
Adrian Flejszer 20 Reputation points
1 answer

Servicenow linked service used connectivity vendor

I am interested in using Servicenow Linked Service to extract data from Servicenow. There are two linked services available; the legacy version and version 2 that uses table API. The documentation mentions a built-in driver for enabling connectivity. Can…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,051 questions
asked 2024-06-27T10:50:37.5233333+00:00
Amir Bagheripour 0 Reputation points
edited the question 2024-12-22T13:29:20.1733333+00:00
TP 100.9K Reputation points
1 answer One of the answers was accepted by the question author.

How to read cosmosdb mongodb API objectId field from a synapse analytical collection link

I am linking Synapse serverless sql pool with Cosmosdb with Mongodb API. For background, MongoDb sets its _id and reference ids to objectId(). To do a SQL join on this field, we need to convert the value to string. This is how the data…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,710 questions
asked 2024-12-21T03:46:47.5433333+00:00
Oscar Garcia @ozkary 21 Reputation points
commented 2024-12-22T02:29:50.59+00:00
Vinodh247 26,371 Reputation points MVP
2 answers

Cant find in the metrics about the storage used in dedicated sql pool under Azure Synapse Analytics.

my account have been charged 0.68usd / day when adls gen2 shows me the storage uses 8.7 gb. it does not make sense. are there any way to monitor the exact storage used in Azure Synapse Analytics SQL Storage - Standard - AP Southeast in dedicated sql…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-10-14T03:55:16.1433333+00:00
Eddy Au Yeung 0 Reputation points
commented 2024-12-21T09:09:27.0833333+00:00
menudale9 75 Reputation points
1 answer One of the answers was accepted by the question author.

how to update apache spark pool version from3.3 to 3.4 if don't have any spark pools under the synapse workspace

i dont have spark pools configured under synapse analytics workspaces so how can i update syanpse spark pools to 3.4 version. is there any dependency validation required for this?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
asked 2024-10-23T09:51:20.06+00:00
ANKIT GHENGE 40 Reputation points
commented 2024-12-20T14:14:00.0033333+00:00
ANKIT GHENGE 40 Reputation points
1 answer One of the answers was accepted by the question author.

not being able to create azure free account or even to upgrade to pay as u go

how am i suppose to learn the certification if am not being able to create account. i am really frustrated that am not being able to create account. provide me an efficient way to create account to practice for my certification

Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
5,253 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,092 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,285 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,051 questions
asked 2024-12-18T20:10:24.3266667+00:00
ashfa 25 Reputation points
edited the question 2024-12-20T13:40:32.9233333+00:00
simo-k 1,360 Reputation points