Getting a true 95th percentile in DataDog

user_2236401 0
Viewed 4457

I have an application that publishes a metric to DataDog with multiple tags, and my DataDog agent has a line that looks like

histogram_percentiles: 90, 95, 99

So my metric (lets call it ResponseTime) has a metric in the DataDog viewer for each of those (i.e. ResponseTime.90perentile).

However if you look at this metric carefully it appears to be calculating these percentiles on a short range (not sure what) and for each tuple of the tags that exist.

Ideally what I'd like to get is a 95th percentile of the ResponseTime metric over all the tags (maybe I filter it down by 1 or 2 and have a couple of different graphs) but over the last week or so. Is there an easy way to do this?

datadog
2 Answers

Datadog now supports the distribution metric type which aggregates data on the Datadog server-side instead of in flash intervals on the agent side (like histograms). This allows for true p95s, etc. to be calculated over any time period.

After starting to emit a distribution metric, you'll need to enable the percentiles for the metric on the Metric Summary page:

Metric summary percentiles selection

Then you should be able to see the percentiles on the graphing editor:

Graphing editor with percentiles

You'll also need to use a new name for the metric if you change it from a histogram to a distribution metric.

user_34866750
Related