Prometheus and HDInsight Integration

Viewed 121

Recently I am working on a new Telemetry design where plenty of microservices should be monitored for performance, maintenance, and other reasons.

The monitoring of microservices can be archived using the EcoSystem of TimescaleDB, Prometheus, and Grafana, while there are many charts like timescale\tobs that are offering this ecosystem out-of-the-box.

enter image description here

But in the case of the Bussiness Central (SAAS), while this is hosted on Microsoft, the telemetry metrics are on HDInsight without access to the underlying infrastructure.

enter image description here

I am looking at how HDInsight metrics can be integrated into Prometheus, any ideas?

1 Answers

I don't have much idea about Azure HDInsight, but seeing monitoring on Azure HDinsights I see Ambari as the recommended tool. There is an Prometheus Ambari exporter provided by Microsoft here, which you can scrape using Prometheus and remote-write into TimescaleDB using Promscale.

I hope this is helpful.

Related