Azure managed prometheus remote_write

yd7474 60 Reputation points
2023-03-14T13:23:22.52+00:00

Hi there,

I am currently using the Prometheus-stack on my AKS cluster and it is working great. For instance, I am able to use rabbitmq-exporter and view 10991 and 763 grafana dashboards (rabbitmq dashboards).

Now, I would like to work with Azure Managed Prometheus and Grafana. I have created a monitoring workspace and managed Grafana as needed, and it is working fine and showing me initial metrics about my cluster.

I would like to add my application data to this Prometheus and remote_write my Prometheus to Azure Managed Prometheus. To do this, I followed the step-by-step guide from this tutorial: https://zcusa.951200.xyz/en-us/azure/azure-monitor/essentials/prometheus-remote-write#verify-remote-write-is-working-correctly. I checked my sidecar container (prom-rermotewrite) and the logs look fine, as described here: https://zcusa.951200.xyz/en-us/azure/azure-monitor/essentials/prometheus-remote-write#verify-remote-write-is-working-correctly.

However, when I try to add 10991 and 763 dashboards to my Azure Managed Grafana, it does not show the rabbitmq data. What could be the problem? Do I need to configure Azure Managed Prometheus scraping configuration or something?

I don't know how to proceed from here, I would appreciate help

Thanks

Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
3,285 questions
Azure Managed Grafana
Azure Managed Grafana
An Azure service used to deploy Grafana dashboards for analytics and monitoring solutions.
106 questions
{count} votes

1 answer

Sort by: Most helpful
  1. tbgangav-MSFT 10,416 Reputation points
    2023-03-15T06:35:47.45+00:00

    Hi @yd7474 ,

    Glad to know that it works and thank you for reporting it. This might help others experiencing the same. Since Microsoft Q&A community has a policy that "Author of the question cannot accept their own answer. They can only accept answers by others" so I will repost your response in case you would like to "Accept" the answer.

    Issue:

    • You are currently using the Prometheus-stack on AKS cluster and it is working. For instance, you were able to use rabbitmq-exporter and view 10991 and 763 grafana dashboards (rabbitmq dashboards).
    • You wanted to work with Azure Managed Prometheus and Grafana and so created a monitoring workspace and managed Grafana as needed, it was working fine and showing initial metrics about cluster.
    • The requirement was to add application data to this Prometheus and remote_write Prometheus to Azure Managed Prometheus. To do this, you have followed the step-by-step guide from this tutorial. On checking sidecar container (prom-rermotewrite), the logs look fine as described here.
    • However, when tried to add 10991 and 763 dashboards to Azure Managed Grafana, it does not show the rabbitmq data!

    Solution:

    • Just had to wait for some time for it to show the rabbitmq data.

    However, you have reported that you encounter indentation problems with the YAML file provided in this tutorial. Please elaborate and raise a document enhancement feedback by clicking on "This page" button under the Feedback section here so that a GitHub issue will be created and document would be enhanced appropriately. For illustration, adding a screenshot of the Feedback section below.

    Feedback section

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.