[YARN-6435] [ATSv2] Can't retrieve more than 1000 versions of metrics in time series

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 2.9.0, YARN-5355, YARN-5355-branch-2, 3.0.0-alpha4
• Component/s: timelineserver
• Target Version/s: YARN-5355, 3.0.0-alpha4
• Hadoop Flags: Reviewed
• Assignee: Vrushali C
• Reporter: Rohith Sharma K S
• Created: 04/Apr/17 06:11
• Updated: 24/Apr/18 20:49
• Resolved: 10/May/17 04:19

Description

It is observed that, even though metricslimit is set to 1500, maximum number of metrics values retrieved is 1000.

This is due to, while creating EntityTable, metrics column family max version is specified as 1000 which is hardcoded in EntityTable#DEFAULT_METRICS_MAX_VERSIONS. So, HBase will return max version with following MIN(cf max version , user provided max version).

This behavior is contradicting the documentation which claims that

metricslimit - If specified, defines the number of metrics to return. Considered only if fields contains METRICS/ALL or metricstoretrieve is specified. Ignored otherwise. The maximum possible value for metricslimit can be maximum value of Integer. If it is not specified or has a value less than 1, and metrics have to be retrieved, then metricslimit will be considered as 1 i.e. latest single value of metric(s) will be returned.