[YARN-4773] Log aggregation performs extraneous filesystem operations when rolling log aggregation is disabled - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Minor
Resolution: Fixed
Affects Version/s: 2.6.0
Fix Version/s: 2.8.0, 2.7.3, 2.6.5, 3.0.0-alpha1
Component/s: nodemanager
Labels:
None

Hadoop Flags:

Reviewed

Description

I noticed when log aggregation occurs for an application the nodemanager is listing the application's log directory in HDFS. Apparently this is for removing old logs before uploading new ones. This is a wasteful operation when rolling log aggregation is disabled, since there will be no prior logs in HDFS – aggregation only occurs once when rolling log aggregation is disabled.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

YARN-4773-branch-2.6.patch
29/Mar/16 14:00
1 kB
Jun Gong
YARN-4773.03.patch
27/Mar/16 02:09
5 kB
Jun Gong
YARN-4773.02.patch
25/Mar/16 01:46
5 kB
Jun Gong
YARN-4773.01.patch
10/Mar/16 14:14
5 kB
Jun Gong

Activity

People

Assignee:: Jun Gong

Reporter:: Jason Darrell Lowe

Votes:: 0 Vote for this issue

Watchers:: 15 Start watching this issue

Dates

Created:: 08/Mar/16 15:00

Updated:: 30/Aug/16 01:05

Resolved:: 28/Mar/16 23:08