[YARN-9747] Reduce additional namenode call by EntityGroupFSTimelineStore#cleanLogs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: timelineserver
• Assignee: Prabhu Joseph
• Reporter: Prabhu Joseph
• Created: 14/Aug/19 06:09
• Updated: 23/Oct/19 16:15
• Resolved: 14/Aug/19 08:18

Description

EntityGroupFSTimelineStore#cleanLogs creates additional Namenode RPC call.

cleanLogs:
 while (iter.hasNext()) {
      FileStatus stat = iter.next();
      Path clusterTimeStampPath = stat.getPath();
      if (isValidClusterTimeStampDir(clusterTimeStampPath)) {
        MutableBoolean appLogDirPresent = new MutableBoolean(false);

{ fs.getFileStatus(clusterTimeStampPath);}} in isValidClusterTimeStampDir* creates additional Namenode RPC call.

cc bibinchundatt

Issue Links

• is caused by: YARN-9080 Bucket Directories as part of ATS done accumulates