This is a limitation in the current Grafana software. Since we host Grafana on two VMs and there is no synchronization between them, you get duplicate alerts unfortunately. We've made a feature request to Grafana Labs. Hopefully they'll have a solution soon.
Duplicate alerts firing in Azure Managed Grafana
As the title says, I am receiving duplicate alert notifications when using Azure Managed Grafana. I believe that AMG uses high availability with two nodes, and this could be related to this issue that was opened in the Grafana GitHub, and that some users were able to resolve by ensuring proper network connectivity between the instances.
The aforementioned GitHub issue can be found here: https://github.com/grafana/grafana/issues/53990
2 answers
Sort by: Most helpful
-
-
Ye Gu 361 Reputation points Microsoft Employee
2023-01-23T16:06:45.6866667+00:00 This HA implementation doesn't work for our current setup since it uses a static configuration. We use VMSS for hosting and rely on the Compute layer to assign IP addresses dynamically. We don't know what these addresses are ahead of the time to put into the configuration file. In addition, IP addresses can change when VMs need to be replaced. As mentioned, we're pushing for an alternative solution with Grafana Labs though we haven't gotten an agreement on that proposal yet.