Hello Team, We have configured the ADLS2 as source and scan it. For the data Quality, we did the following the steps : Create the Governance domain and publish it. Create the Data Product and add the tables. In the Data Quality section, add the connect and apply the Quality rules. However, we are getting the below error: **Max Retry Count Reached. Ending Workflow. Current Task HandleError** while doing the profiling, we are getting this error : Unable to submit job to PFS with exception: Unable to submit job to Pfs Service. Could you please take a look and help with this issue. Thanks & Regards, Dhaval Pujara

Data Quality issue in the Purview

Dhaval Pujara 0

Hello Team,

We have configured the ADLS2 as source and scan it. For the data Quality, we did the following the steps :

Create the Governance domain and publish it.
Create the Data Product and add the tables.
In the Data Quality section, add the connect and apply the Quality rules. However, we are getting the below error:
```
 **Max Retry Count Reached. Ending Workflow. Current Task HandleError**
```
while doing the profiling, we are getting this error : Unable to submit job to PFS with exception: Unable to submit job to Pfs Service.

Could you please take a look and help with this issue.

Thanks & Regards,

Dhaval Pujara

Chandra Boorla 3,230 Reputation points Microsoft Vendor

2024-11-12T06:46:20.3033333+00:00
Hi @Dhaval Pujara

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

Please refer to the thread discussing a similar issue, as it may provide you with some useful insights.

Thread link: https://zcusa.951200.xyz/en-us/answers/questions/1683883/failed-job-status-in-data-quality-scan-in-purview.

Additionally, please refer the below Microsoft documentation that might help you.

Data quality troubleshooting

Monitor data quality jobs

I hope this information helps. Please do let us know if you have any further queries.

Thank you.
Chandra Boorla 3,230 Reputation points Microsoft Vendor

2024-11-13T06:11:40.2666667+00:00

@Dhaval Pujara

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Thank you.
Dhaval Pujara 0 Reputation points

2024-11-13T06:19:24.95+00:00

Hello Chandra Boorla,

Thanks for sharing the soultions. However, still I am facing the same issue.
Chandra Boorla 3,230 Reputation points Microsoft Vendor

2024-11-15T09:13:20.4+00:00
@Dhaval Pujara

Apologies for the inconvenience.

The errors you are encountering during the Data Quality process in Microsoft Purview could be due to several reasons:

Max Retry Count Reached:

This error typically indicates that the system has attempted to process a task multiple times but has failed each time. This can happen if there are issues with the data format or if the data source is not accessible. Ensure that the data in your ADLS2 is in the correct format and that the connection to the data source is properly configured.

Unable to submit job to PFS:

This error suggests that there may be a problem with the service responsible for processing the job. It could be related to the configuration of your data source connection or issues with the underlying service. Make sure that your connection settings are correct and that the necessary permissions are granted.

To troubleshoot these issues, please consider the following:

Ensure that the data in your tables is in the correct format and that all required configurations have been completed.

Verify that the Microsoft Purview Managed Identity (MSI) has the necessary permissions to access the data source.

Reference: Data quality troubleshooting

I hope this information helps, please do let us know if you have any further queries.

Thank you.

Share via

Data Quality issue in the Purview

Your answer