Some of the tables are not created with azure synapse link

Kvaratshelya, Vladimir 25

I created an Azure Synapse Link for Dataverse in Azure Synapse Workspace.

The folders with Snapshot and csv files for each dataverse entity are created in Azure Data Lake Storage Gen2.

However, not all the tables are showing in workspace Lake database.

Example: Table X is not in lake database even if folder X (with files) exists in storage account.

There is no option to map these tables manually.

Any suggestions?

Smaran Thoomu 16,155 Reputation points Microsoft Vendor

2024-08-14T12:11:31.2866667+00:00
@Kvaratshelya, Vladimir -Thanks for the question and using MS Q&A platform.

It sounds like you’re experiencing an issue where some tables are not appearing in the Azure Synapse Workspace Lake database, even though their corresponding folders and files exist in Azure Data Lake Storage Gen2. Here are a few suggestions to troubleshoot this problem:

Check Resource Group Locations: Ensure that the managed resource group used by Azure Synapse Workspace is in the same location as the Workspace itself and the Database environment. This mismatch can sometimes cause tables not to appear.

Enable Change Tracking: Verify that change tracking is enabled for the entities you want to sync. If you have recently enabled change tracking, it might take some time for the entities to show up.

Review Synapse Link Configuration: Make sure that the Azure Synapse Link configuration is correct and that all necessary permissions are granted. Sometimes, missing permissions can prevent tables from being displayed.

Manual Refresh: Try refreshing the Lake database in the Synapse Workspace. Sometimes, a manual refresh can help in updating the database with the latest tables.

If these steps don’t resolve the issue, you might want to check the detailed documentation or reach out to Microsoft support for further assistance.

Refer the below links for more information:

Dataverse to Synapse Link - missing Lake database in Workspace

Setting up Azure Synapse Link for Dynamics 365/Dataverse

I hope this helps. Let me know if you have any further questions.
Kvaratshelya, Vladimir 25 Reputation points

2024-08-15T13:58:18.7066667+00:00
@Smaran Thoomu Thank you for your response.

I have reviewed the situation and would like to share my findings:

Check Resource Group Locations: The locations for the resource group and the workspace are identical. Both are within the same subscription.

Change Tracking: Change tracking is enabled. As mentioned earlier, while files are being created in the storage account, certain tables are not being created in the lake database.

Review of Synapse Link Configuration: Upon creating the Azure Synapse Link, the only configuration option available is to manage tables. Permissions were correctly configured at the time of the Link’s creation; otherwise, no tables would have been populated in the storage account.

Manual Refresh: I have performed multiple manual refreshes, but there has been no change.
Kvaratshelya, Vladimir 25 Reputation points

2024-08-15T14:00:12.88+00:00

.....
Chandra Boorla 2,125 Reputation points Microsoft Vendor

2024-08-19T13:13:35.1+00:00

Hi @Kvaratshelya, Vladimir

Has this issue been resolved for you? If not, please let us know. Your response will help us assist others in the community who may face a similar issue.
phemanth 10,725 Reputation points Microsoft Vendor

2024-08-20T15:07:48.79+00:00

@Kvaratshelya, Vladimir We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Kvaratshelya, Vladimir 25 Reputation points

2024-08-20T15:28:39.9866667+00:00

No, the issue has not been resolved yet. I have contacted support, and they are currently working on finding a solution.

I’ll update this thread with the resolution as soon as it’s available.
Kvaratshelya, Vladimir 25 Reputation points

2024-08-20T15:37:27.8833333+00:00

No, the issue hasn't been resolved yet. I’ve contacted support, and they are currently working on finding a solution. I’ll update this thread with the resolution as soon as it’s available.
Smaran Thoomu 16,155 Reputation points Microsoft Vendor

2024-08-22T04:27:59.9333333+00:00

@Kvaratshelya, Vladimir Thanks for the update. Could you please share the support request to track internally.

Once the issue has been resolved, please do consider sharing the solution, which might be beneficial to other community members reading this thread.
Smaran Thoomu 16,155 Reputation points Microsoft Vendor

2024-08-23T18:34:08.2766667+00:00

@Kvaratshelya, Vladimir We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Kvaratshelya, Vladimir 25 Reputation points

2024-08-26T12:18:47.0466667+00:00

I unlinked the Azure Synapse Link in Power Apps and then recreated it, choosing to import fewer tables than before. This resolved the issue we were experiencing. I believe the success was due to my decision to import fewer tables.
Smaran Thoomu 16,155 Reputation points Microsoft Vendor

2024-08-26T14:09:04.3366667+00:00

@Kvaratshelya, Vladimir Glad to know your issue has been resolved. Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others "I'll repost your solution in case you'd like to accept the answer.

Accepted answer

Smaran Thoomu 16,155 Reputation points Microsoft Vendor

2024-08-26T14:08:39.6+00:00

Hi @Kvaratshelya, Vladimir

I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

Issue: I created an Azure Synapse Link for Dataverse in Azure Synapse Workspace.

The folders with Snapshot and csv files for each dataverse entity are created in Azure Data Lake Storage Gen2.

However, not all the tables are showing in workspace Lake database.

Example: Table X is not in lake database even if folder X (with files) exists in storage account.

There is no option to map these tables manually.

Any suggestions?

Solution: I unlinked the Azure Synapse Link in Power Apps and then recreated it, choosing to import fewer tables than before. This resolved the issue we were experiencing. I believe the success was due to my decision to import fewer tables.

If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

I hope this helps!

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.

1 person found this answer helpful.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Some of the tables are not created with azure synapse link

0 additional answers

Your answer