Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-23008

AMS: SUM downsampling function works incorrectly

    XMLWordPrintableJSON

Details

    Description

      AMS, by default does not sum up across time dimension. However, there are certain metric cases where this is useful.

      Aggregation Scenario - How it should work

      Let's say in Host H1 - the metric values for 'topology.streamline-2-test-clone.3-KAFKA.TASK1.--emit-count.STREAM1' are 1,1,0,1,2 in time 10:01 to 10:05 (1 minute values) respectively

      And, in Host H2 - the metric values for the same metric are 1,0,2,2,1 respectively

      AMS will first aggregate across hosts. 'Sum' aggregation -> 2,1,2,3,3 (10:01 - 10:05) and then across time (downsampling) for larger windows. In time based downsampling, the 'sum' value will be 11 (2 + 1 + 2 + 3 + 3) at 10:05.

      Also, such metrics should not be interpolated, because the injected values will cause wrong summed up values.

       Work
      A new custom downsampler was added which implements the above logic.

      Attachments

        Activity

          People

            avijayan Aravindan Vijayan
            avijayan Aravindan Vijayan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 50m
                50m