Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-12248

Metrics API result set contains a lot of data outside the requested time range

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.1.1
    • Component/s: ambari-metrics
    • Labels:
      None

      Description

      When I access the Host Details page for :

      http://172.22.76.13:8080/api/v1/clusters/leapsec/hosts/leapsec-rhel6-11.openstacklocal?fields=metrics/cpu/cpu_user[1436028521,1436032121,15],metrics/cpu/cpu_wio[1436028521,1436032121,15],metrics/cpu/cpu_nice[1436028521,1436032121,15],metrics/cpu/cpu_aidle[1436028521,1436032121,15],metrics/cpu/cpu_system[1436028521,1436032121,15],metrics/cpu/cpu_idle[1436028521,1436032121,15]&_=1435698892786
      

      However, look at the screenshot. The start time (1435946268) and using the standard +3600 seconds for the end time (1435949868), the following call was made:

      http://172.22.76.13:8080/api/v1/clusters/leapsec/hosts/leapsec-rhel6-11.openstacklocal?fields=metrics/cpu/cpu_user[1435946268,1435949868,15],metrics/cpu/cpu_wio[1435946268,1435949868,15],metrics/cpu/cpu_nice[1435946268,1435949868,15],metrics/cpu/cpu_aidle[1435946268,1435949868,15],metrics/cpu/cpu_system[1435946268,1435949868,15],metrics/cpu/cpu_idle[1435946268,1435949868,15]&_=1435698626557
      

      This resulted in 13.6MB of data transferred in 12.05s. The result set size is exactly consistent with what is in the screenshot.
      Note that this result set contained a bunch of data that are outside of the time window specified [1435946268,1435949868).

        Issue Links

          Activity

          Hide
          hadoopqa Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12743168/buggy-cpu-graph-api-call.png
          against trunk revision .

          -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/3331//console

          This message is automatically generated.

          Show
          hadoopqa Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12743168/buggy-cpu-graph-api-call.png against trunk revision . -1 patch . The patch command could not apply the patch. Console output: https://builds.apache.org/job/Ambari-trunk-test-patch/3331//console This message is automatically generated.
          Hide
          swagle Siddharth Wagle added a comment -

          Pushed to trunk.

          Show
          swagle Siddharth Wagle added a comment - Pushed to trunk.
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Ambari-trunk-Commit #3062 (See https://builds.apache.org/job/Ambari-trunk-Commit/3062/)
          AMBARI-12248. Metrics API result set contains a lot of data outside the requested time range. (swagle) (swagle: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=7763a47eb1a7f23aa015de490fd04f976cdce6c8)

          • ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/MetricsPaddingMethodTest.java
          • ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProviderTest.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/spi/TemporalInfo.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProvider.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProvider.java
          • ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java
          • ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/query/PhoenixTransactSQL.java
          • ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricConfiguration.java
          • ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProviderTest.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsDownsamplingMethodFactory.java
          • ambari-server/src/test/resources/ams/single_host_component_metrics.json
          • ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/ganglia/TestStreamProvider.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricReportingAdapter.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsDownsamplingMethod.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/internal/TemporalInfoImpl.java
          • ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/AbstractMiniHBaseClusterTest.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/internal/AbstractPropertyProvider.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Ambari-trunk-Commit #3062 (See https://builds.apache.org/job/Ambari-trunk-Commit/3062/ ) AMBARI-12248 . Metrics API result set contains a lot of data outside the requested time range. (swagle) (swagle: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=7763a47eb1a7f23aa015de490fd04f976cdce6c8 ) ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/MetricsPaddingMethodTest.java ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProviderTest.java ambari-server/src/main/java/org/apache/ambari/server/controller/spi/TemporalInfo.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProvider.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProvider.java ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/query/PhoenixTransactSQL.java ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricConfiguration.java ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProviderTest.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsDownsamplingMethodFactory.java ambari-server/src/test/resources/ams/single_host_component_metrics.json ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/ganglia/TestStreamProvider.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricReportingAdapter.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsDownsamplingMethod.java ambari-server/src/main/java/org/apache/ambari/server/controller/internal/TemporalInfoImpl.java ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/AbstractMiniHBaseClusterTest.java ambari-server/src/main/java/org/apache/ambari/server/controller/internal/AbstractPropertyProvider.java
          Hide
          swagle Siddharth Wagle added a comment -

          Re-opening Jira to wait on 2.1.1 branch.

          Show
          swagle Siddharth Wagle added a comment - Re-opening Jira to wait on 2.1.1 branch.
          Hide
          swagle Siddharth Wagle added a comment -

          Pushed to branch-2.1

          Show
          swagle Siddharth Wagle added a comment - Pushed to branch-2.1
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Ambari-branch-2.1 #240 (See https://builds.apache.org/job/Ambari-branch-2.1/240/)
          AMBARI-12248. Metrics API result set contains a lot of data outside the requested time range. (swagle) (swagle: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=6d8673732503999690b5345b56835c28e460d913)

          • ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProviderTest.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/internal/AbstractPropertyProvider.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricReportingAdapter.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/internal/TemporalInfoImpl.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/spi/TemporalInfo.java
          • ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/MetricsPaddingMethodTest.java
          • ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/query/PhoenixTransactSQL.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsDownsamplingMethodFactory.java
          • ambari-server/src/test/resources/ams/single_host_component_metrics.json
          • ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricConfiguration.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsDownsamplingMethod.java
          • ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProviderTest.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProvider.java
          • ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/ganglia/TestStreamProvider.java
          • ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProvider.java
          • ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/AbstractMiniHBaseClusterTest.java
          • ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Ambari-branch-2.1 #240 (See https://builds.apache.org/job/Ambari-branch-2.1/240/ ) AMBARI-12248 . Metrics API result set contains a lot of data outside the requested time range. (swagle) (swagle: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=6d8673732503999690b5345b56835c28e460d913 ) ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProviderTest.java ambari-server/src/main/java/org/apache/ambari/server/controller/internal/AbstractPropertyProvider.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricReportingAdapter.java ambari-server/src/main/java/org/apache/ambari/server/controller/internal/TemporalInfoImpl.java ambari-server/src/main/java/org/apache/ambari/server/controller/spi/TemporalInfo.java ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/MetricsPaddingMethodTest.java ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/query/PhoenixTransactSQL.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsDownsamplingMethodFactory.java ambari-server/src/test/resources/ams/single_host_component_metrics.json ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricConfiguration.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsDownsamplingMethod.java ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProviderTest.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProvider.java ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/ganglia/TestStreamProvider.java ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProvider.java ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/AbstractMiniHBaseClusterTest.java ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java

            People

            • Assignee:
              swagle Siddharth Wagle
              Reporter:
              swagle Siddharth Wagle
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development