Query weak consistency policy
Applies to: ✅ Azure Data Explorer
The query weak consistency policy is a cluster-level policy object that configures the weak consistency service.
Management commands
- Use
.show cluster policy query_weak_consistencyto show the current query weak consistency policy of the cluster. - Use
.alter cluster policy query_weak_consistencyto change the current query weak consistency policy of the cluster.
The policy object
The query weak consistency policy includes the following properties:
| Property | Description | Values | Default |
|---|---|---|---|
| PercentageOfNodes | The percentage of nodes in the cluster that execute the query weak consistency service (the selected nodes will execute the weakly consistent queries). | An integer between 1 to 100, or -1 for default value (which is currently 20%). |
-1 |
| MinimumNumberOfNodes | Minimum number of nodes that execute the query weak consistency service (will determine the number of nodes in case PercentageOfNodes*#NodesInCluster is smaller). |
A positive integer, or -1 for default value (which is currently 2). Smaller or equal to MaximumNumberOfNodes. |
-1 |
| MaximumNumberOfNodes | Maximum number of nodes that execute the query weak consistency service (will determine the number of nodes in case PercentageOfNodes*#NodesInCluster is greater). |
A positive integer, or -1 for default value (which is currently 30). Greater or equal to MinimumNumberOfNodes. |
-1 |
| SuperSlackerNumberOfNodesThreshold | If the total number of nodes in the cluster exceeds this number, nodes that execute the weak consistency service will become 'super slacker', meaning they won't have data on them (in order to reduce load). See Warning below. | A positive integer that is greater than or equal to 4, or -1 for default value (currently no threshold - weak consistency nodes won't become 'super slacker'). |
-1 |
| EnableMetadataPrefetch | When set to true, database metadata will be pre-loaded when the cluster comes up, and reloaded every few minutes, on all weak consistency nodes. When set to false, database metadata load will be triggered by queries (on demand), so some queries might be delayed (until the database metadata is pulled from storage). Database metadata must be reloaded from storage to query the database, when its age is greater than MaximumLagAllowedInMinutes. See Warning and Important below. |
true or false |
false |
| MaximumLagAllowedInMinutes | The maximum duration (in minutes) that weakly consistent metadata is allowed to lag behind. If metadata is older than this value, the most up-to-date metadata will be pulled from storage (when the database is queried, or periodically if EnableMetadataPrefech is enabled). See Warning below. |
An integer between 1 to 60, or -1 for default value (currently 5 minutes). |
-1 |
| RefreshPeriodInSeconds | The refresh period (in seconds) to update a database metadata on each weak consistency node. See Warning below. | An integer between 30 to 1800, or -1 for default value (currently 120 seconds). |
-1 |
Important
Prefetch operation requires pulling all databases metadata from Azure storage every few minutes (in all weak consistency nodes). This operation puts a load on the underlying storage resources and has impact on cluster performance.
Warning
Consult with the support team before altering this property.
Default policy
The default policy is:
{
"PercentageOfNodes": -1,
"MinimumNumberOfNodes": -1,
"MaximumNumberOfNodes": -1,
"SuperSlackerNumberOfNodesThreshold": -1,
"EnableMetadataPrefetch": false,
"MaximumLagAllowedInMinutes": -1,
"RefreshPeriodInSeconds": -1
}