Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5355 YARN Timeline Service v.2: alpha 2
  3. YARN-6435

[ATSv2] Can't retrieve more than 1000 versions of metrics in time series

    Details

      Description

      It is observed that, even though metricslimit is set to 1500, maximum number of metrics values retrieved is 1000.

      This is due to, while creating EntityTable, metrics column family max version is specified as 1000 which is hardcoded in EntityTable#DEFAULT_METRICS_MAX_VERSIONS. So, HBase will return max version with following MIN(cf max version , user provided max version).

      This behavior is contradicting the documentation which claims that

      metricslimit - If specified, defines the number of metrics to return. Considered only if fields contains METRICS/ALL or metricstoretrieve is specified. Ignored otherwise. The maximum possible value for metricslimit can be maximum value of Integer. If it is not specified or has a value less than 1, and metrics have to be retrieved, then metricslimit will be considered as 1 i.e. latest single value of metric(s) will be returned.
      

        Attachments

        1. YARN-6435.YARN-5355.0002.patch
          4 kB
          Rohith Sharma K S
        2. YARN-6435.YARN-5355.0001.patch
          3 kB
          Rohith Sharma K S
        3. YARN-6435.0001.patch
          1 kB
          Rohith Sharma K S

          Activity

            People

            • Assignee:
              vrushalic Vrushali C
              Reporter:
              rohithsharma Rohith Sharma K S
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: